Jun 19 04:05:32 devstack cinder-volume[82267]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 19 04:05:32 devstack cinder-volume[82267]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:05:32 devstack cinder-volume[82267]: we strongly recommend against using it for new projects. Jun 19 04:05:32 devstack cinder-volume[82267]: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:05:32 devstack cinder-volume[82267]: framework. For more detail see Jun 19 04:05:32 devstack cinder-volume[82267]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:05:32 devstack cinder-volume[82267]: import eventlet # noqa Jun 19 04:05:35 devstack cinder-volume[82267]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:05:35 devstack cinder-volume[82267]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:05:35 devstack cinder-volume[82267]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:05:36 devstack cinder-volume[82267]: INFO dbcounter [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Registered counter for database cinder Jun 19 04:05:36 devstack cinder-volume[82267]: DEBUG oslo_db.sqlalchemy.engines [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:05:36 devstack cinder-volume[82267]: DEBUG dbcounter [-] [82267] Writer thread running {{(pid=82267) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:05:36 devstack cinder-volume[82267]: INFO cinder.rpc [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 19 04:05:36 devstack cinder-volume[82267]: INFO cinder.rpc [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 19 04:05:36 devstack cinder-volume[82267]: DEBUG oslo_db.sqlalchemy.engines [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:05:37 devstack cinder-volume[82267]: INFO cinder.volume.manager [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Determined volume DB was empty at startup. Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG cinder.volume.manager [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82267) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 19 04:05:37 devstack cinder-volume[82267]: INFO cinder.volume.manager [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 19 04:05:37 devstack cinder-volume[82267]: WARNING stevedore.named [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 04:05:37 devstack cinder-volume[82267]: WARNING castellan.key_manager [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:05:37 devstack cinder-volume[82267]: WARNING cinder.keymgr.conf_key_mgr [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG cinder.volume.drivers.lvm [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82267) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_concurrency.processutils [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_concurrency.processutils [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] CMD "cinder-rtstool verify" returned: 0 in 0.377s {{(pid=82267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_db.sqlalchemy.engines [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:05:37 devstack cinder-volume[82267]: INFO cinder.rpc [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 19 04:05:37 devstack cinder-volume[82267]: INFO cinder.rpc [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 19 04:05:37 devstack cinder-volume[82267]: WARNING stevedore.named [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 04:05:37 devstack cinder-volume[82267]: WARNING castellan.key_manager [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:05:37 devstack cinder-volume[82267]: INFO cinder.volume.manager [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_db.sqlalchemy.engines [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:05:37 devstack cinder-volume[82267]: INFO oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Starting 1 workers Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Started child 82427 {{(pid=82267) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Full set of CONF: {{(pid=82267) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] ******************************************************************************** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Configuration options gathered from: {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] ================================================================================ {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] allow_availability_zone_fallback = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] allow_compression_on_image_upload = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] allowed_direct_url_schemes = [] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] api_rate_limit = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] auth_strategy = keystone {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] az_cache_duration = 3600 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_availability_zone = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_host = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_name = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_stats_polling_interval = 60 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backup_api_class = cinder.backup.api.API {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backup_name_template = backup-%s {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backup_use_same_host = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backup_use_temp_snapshot = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] chap_password = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] chap_username = {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cinder_internal_tenant_project_id = 9c4d96b1465343faa40cb4a087e6cdde {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82427]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cinder_internal_tenant_user_id = 7a6ade5971ca49c1a39d94d7f47279f2 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cloned_volume_same_az = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cluster = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] compression_format = gzip {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] compute_api_class = cinder.compute.nova.API {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] config_dir = [] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] config_source = [] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] control_exchange = openstack {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] debug = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] default_availability_zone = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] default_group_type = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] default_volume_type = lvmdriver-1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] disk_geometry = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] driver_client_cert = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] driver_client_cert_key = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] driver_data_namespace = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] driver_ssl_cert_path = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] driver_ssl_cert_verify = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] driver_use_ssl = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] enable_force_upload = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] enable_new_services = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] enable_unsupported_driver = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] enforce_multipath_for_image_xfer = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] filter_function = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance_api_insecure = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance_api_servers = ['http://192.168.122.126/image'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance_api_ssl_compression = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance_ca_certificates_file = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance_catalog_info = image:glance:publicURL {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance_certfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance_keyfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance_num_retries = 3 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance_request_timeout = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] goodness_function = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] graceful_shutdown_timeout = 5 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] group_api_class = cinder.group.api.API {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] host = devstack {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] image_compress_on_upload = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] image_conversion_address_space_limit = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] image_conversion_cpu_limit = 60 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] image_conversion_disable = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] image_upload_use_cinder_backend = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] image_upload_use_internal_tenant = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] image_volume_cache_enabled = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] image_volume_cache_max_count = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] image_volume_cache_max_size_gb = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] init_host_max_objects_retrieval = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] instance_format = [instance: %(uuid)s] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] iscsi_target_flags = {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] iscsi_write_cache = on {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] iser_helper = tgtadm {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] iser_ip_address = 192.168.122.126 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] iser_port = 3260 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] log_color = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] log_config_append = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] log_dir = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] log_file = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] log_options = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] log_rotate_interval = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] log_rotate_interval_type = days {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] log_rotation_type = none {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] max_age = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] max_logfile_count = 30 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] max_logfile_size_mb = 200 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] max_over_subscription_ratio = 20.0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] message_reap_interval = 86400 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] message_ttl = 2592000 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] migration_create_volume_timeout_secs = 300 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] monkey_patch = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] monkey_patch_modules = [] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] my_ip = 192.168.122.126 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] no_snapshot_gb_quota = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] num_iser_scan_tries = 3 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] num_shell_tries = 3 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] num_volume_device_scan_tries = 3 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] nvmeof_conn_info_version = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] nvmet_ns_id = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] nvmet_port_id = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] osapi_max_limit = 1000 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] osapi_volume_ext_list = [] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] osapi_volume_listen_port = 8776 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] osapi_volume_use_ssl = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] osapi_volume_workers = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] per_volume_size_limit = -1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] periodic_fuzzy_delay = 60 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] periodic_interval = 60 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] public_endpoint = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] publish_errors = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] quota_backup_gigabytes = 1000 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] quota_backups = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] quota_gigabytes = 1000 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] quota_groups = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] quota_snapshots = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] quota_volumes = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] rate_limit_burst = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] rate_limit_except_level = CRITICAL {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] rate_limit_interval = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] reinit_driver_count = 3 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] replication_device = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] report_discard_supported = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] report_interval = 120 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] reservation_clean_interval = 86400 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] reservation_expire = 86400 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] reserved_image_namespaces = [] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] reserved_percentage = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] rpc_response_timeout = 120 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] run_external_periodic_tasks = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] scst_target_driver = iscsi {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] scst_target_iqn_name = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] service_down_time = 720 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] shell_completion = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] snapshot_name_template = snapshot-%s {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] snapshot_same_host = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] split_loggers = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] state_path = /opt/stack/data/cinder {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] storage_availability_zone = nova {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] storage_protocol = iSCSI {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] syslog_log_facility = LOG_USER {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] target_helper = lioadm {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] target_ip_address = 192.168.122.126 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] target_port = 3260 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] target_protocol = iscsi {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] target_secondary_ip_addresses = [] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] trace_flags = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] transport_url = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] until_refresh = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] use_chap_auth = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] use_default_quota_class = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] use_journal = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] use_json = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] use_multipath_for_image_xfer = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] use_stderr = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] use_syslog = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] verify_glance_signatures = enabled {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] volume_api_class = cinder.volume.api.API {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] volume_backend_name = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] volume_clear = zero {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] volume_clear_ionice = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] volume_clear_size = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] volume_copy_bps_limit = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] volume_dd_blocksize = 1M {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] volume_name_template = volume-%s {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] volume_service_inithost_offload = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] volume_usage_audit_period = month {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] zoning_mode = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_concurrency.disable_process_locking = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.auth_section = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.auth_type = password {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.auth_version = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.cache = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82427]: INFO cinder.volume.manager [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.certfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.include_service_catalog = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.insecure = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.interface = public {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.keyfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_password = {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcache_username = {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.region_name = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.service_type = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.126/identity {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.backend = dogpile.cache.null {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.backend_argument = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.backend_expiration_time = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.config_prefix = cache.oslo {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.debug_cache_backend = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.enable_retry_client = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.enable_socket_keepalive = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.enabled = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.expiration_time = 600 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.hashclient_retry_attempts = 2 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.memcache_dead_retry = 300 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.memcache_pool_maxsize = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.memcache_sasl_enabled = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.password = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.proxies = [] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.redis_db = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.redis_server = localhost:6379 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.retry_attempts = 2 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.retry_delay = 0.0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.socket_keepalive_count = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.socket_keepalive_idle = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.socket_keepalive_interval = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.socket_timeout = 1.0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.tls_allowed_ciphers = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.tls_cafile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.tls_certfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.tls_enabled = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.tls_keyfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cache.username = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] coordination.backend_url = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.asyncio_connection = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.asyncio_slave_connection = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.backend = sqlalchemy {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.connection = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.connection_debug = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.connection_parameters = {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.connection_recycle_time = 3600 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.connection_trace = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.db_inc_retry_interval = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.db_max_retries = 20 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.db_max_retry_interval = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.db_retry_interval = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.max_overflow = 50 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.max_pool_size = 5 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.max_retries = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.mysql_wsrep_sync_wait = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.pool_timeout = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.retry_interval = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.slave_connection = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.sqlite_synchronous = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.synchronous_reader = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] database.use_db_reconnect = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler.connection_string = messaging:// {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler.enabled = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler.es_doc_type = notification {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler.es_scroll_size = 10000 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler.es_scroll_time = 2m {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler.filter_error_trace = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler.hmac_keys = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler.sentinel_service_name = mymaster {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler.socket_timeout = 0.1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler.trace_requests = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler.trace_sqlalchemy = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler_jaeger.process_tags = {} {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler_jaeger.service_name_prefix = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] profiler_otlp.service_name_prefix = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_policy.enforce_new_defaults = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: WARNING oslo_config.cfg [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_policy.enforce_scope = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_policy.policy_default_rule = default {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_policy.policy_file = policy.yaml {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] privsep_osbrick.group = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] privsep_osbrick.helper_command = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] privsep_osbrick.user = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cinder_sys_admin.group = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cinder_sys_admin.helper_command = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] cinder_sys_admin.user = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] service_user.auth_section = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] service_user.auth_type = password {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] service_user.cafile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] service_user.certfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] service_user.collect_timing = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] service_user.insecure = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] service_user.keyfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] service_user.send_service_user_token = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] service_user.split_loggers = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] service_user.timeout = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance.auth_section = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance.auth_type = password {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance.certfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance.collect_timing = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance.insecure = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance.keyfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance.region_name = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance.split_loggers = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] glance.timeout = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.backend_availability_zone = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.chap_password = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.chap_username = {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.disk_geometry = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.driver_client_cert = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.driver_client_cert_key = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.driver_data_namespace = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.driver_use_ssl = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.extra_capabilities = {} {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.filter_function = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.goodness_function = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.iscsi_target_flags = {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.iscsi_write_cache = on {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.iser_helper = tgtadm {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.iser_ip_address = 192.168.122.126 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.iser_port = 3260 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.lvm_share_target = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.lvm_type = auto {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.num_shell_tries = 3 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.replication_device = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.report_discard_supported = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.reserved_percentage = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.target_helper = tgtadm {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.target_ip_address = 192.168.122.126 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.target_port = 3260 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.target_protocol = iscsi {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.trace_flags = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.unique_fqdn_network = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.use_chap_auth = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.volume_backend_name = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.volume_clear = zero {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.volume_clear_ionice = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.volume_clear_size = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_reports.file_event_handler = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_reports.log_dir = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.backend_host = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.chap_password = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.chap_username = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.disk_geometry = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.driver_client_cert = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.extra_capabilities = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.filter_function = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.goodness_function = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.iser_helper = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.iser_ip_address = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.iser_port = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.lvm_share_target = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.lvm_type = auto {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.num_shell_tries = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.replication_device = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.report_discard_supported = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.reserved_percentage = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.scst_target_driver = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.storage_protocol = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.target_helper = lioadm {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.target_ip_address = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.target_port = 3260 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.trace_flags = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.use_chap_auth = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack sudo[82431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.volume_clear = zero {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.volume_clear_size = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] lvmdriver-1.volumes_dir = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack sudo[82431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.ssl = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_notifications.driver = [] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_notifications.retry = -1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] key_manager.fixed_key = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.barbican_api_version = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.barbican_endpoint = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.barbican_endpoint_type = public {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.barbican_region_name = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.cafile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.certfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.collect_timing = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.insecure = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.keyfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.number_of_retries = 60 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.retry_delay = 1 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.send_service_user_token = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.split_loggers = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.timeout = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.verify_ssl = True {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican.verify_ssl_path = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican_service_user.auth_section = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican_service_user.auth_type = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican_service_user.cafile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican_service_user.certfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican_service_user.collect_timing = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican_service_user.insecure = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican_service_user.keyfile = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican_service_user.split_loggers = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] barbican_service_user.timeout = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] vault.approle_role_id = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] vault.approle_secret_id = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] vault.kv_mountpoint = secret {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] vault.kv_path = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] vault.kv_version = 2 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] vault.namespace = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] vault.root_token_id = **** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] vault.ssl_ca_crt_file = None {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] vault.timeout = 60.0 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] vault.use_ssl = False {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:05:37 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] ******************************************************************************** {{(pid=82267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 19 04:05:38 devstack sudo[82431]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:38 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:38 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:38 devstack sudo[82459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:05:38 devstack sudo[82459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:39 devstack sudo[82459]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:39 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.632s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:39 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:05:39 devstack cinder-volume[82427]: INFO cinder.brick.local_dev.lvm [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 19 04:05:39 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:39 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:39 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:39 devstack sudo[82709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:05:39 devstack sudo[82709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:39 devstack sudo[82709]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:39 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:39 devstack cinder-volume[82427]: DEBUG cinder.brick.local_dev.lvm [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82427) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 19 04:05:39 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:39 devstack sudo[82915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:05:39 devstack sudo[82915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:41 devstack sudo[82915]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:41 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.502s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:41 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:41 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:41 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:41 devstack sudo[83200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:05:41 devstack sudo[83200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:42 devstack sudo[83200]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:42 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.703s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:42 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:42 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:42 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:42 devstack sudo[83215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 19 04:05:42 devstack sudo[83215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:42 devstack sudo[83215]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:42 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.826s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:42 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:42 devstack sudo[83219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:05:42 devstack sudo[83219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:43 devstack sudo[83219]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:43 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.849s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:43 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:43 devstack sudo[83230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:05:43 devstack sudo[83230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:44 devstack sudo[83230]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:44 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.796s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:44 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:44 devstack sudo[83235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:05:44 devstack sudo[83235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:45 devstack sudo[83235]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:45 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.725s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:45 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:45 devstack sudo[83244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:05:45 devstack sudo[83244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:45 devstack sudo[83244]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:45 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.690s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:46 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:46 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:46 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:46 devstack sudo[83248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:05:46 devstack sudo[83248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:46 devstack sudo[83248]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:46 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.860s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:46 devstack cinder-volume[82427]: INFO cinder.volume.drivers.lvm [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 19 04:05:46 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:46 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:46 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:46 devstack sudo[83325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:05:46 devstack sudo[83325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:47 devstack sudo[83325]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:47 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:47 devstack cinder-volume[82427]: DEBUG cinder.volume.drivers.lvm [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Updating volume stats {{(pid=82427) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:05:47 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:47 devstack sudo[83374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:05:47 devstack sudo[83374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:47 devstack cinder-volume[82267]: DEBUG dbcounter [-] [82267] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82267) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:05:48 devstack sudo[83374]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:48 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:48 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:48 devstack sudo[83515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:05:48 devstack sudo[83515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:48 devstack sudo[83515]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:48 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:48 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:48 devstack sudo[83519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:05:48 devstack sudo[83519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:49 devstack sudo[83519]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:49 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:49 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:49 devstack sudo[83522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:05:49 devstack sudo[83522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:50 devstack sudo[83522]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:50 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:50 devstack cinder-volume[82427]: INFO cinder.volume.driver [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Driver hasn't implemented _init_vendor_properties() Jun 19 04:05:50 devstack cinder-volume[82427]: DEBUG cinder.volume.driver [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82427) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 19 04:05:50 devstack cinder-volume[82427]: DEBUG oslo_db.sqlalchemy.engines [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82427) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:05:50 devstack cinder-volume[82427]: DEBUG dbcounter [-] [82427] Writer thread running {{(pid=82427) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:05:50 devstack cinder-volume[82427]: DEBUG cinder.db.api [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Building query based on filter {{(pid=82427) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 19 04:05:50 devstack cinder-volume[82427]: DEBUG cinder.image.image_utils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82427) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 19 04:05:50 devstack cinder-volume[82427]: INFO cinder.keymgr.migration [None req-dcc3526a-a419-475e-8c6d-d33a01a1fbad None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 19 04:05:50 devstack cinder-volume[82427]: DEBUG cinder.volume.drivers.lvm [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Updating volume stats {{(pid=82427) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:05:50 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:50 devstack sudo[83528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:05:50 devstack sudo[83528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:50 devstack sudo[83528]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:50 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:50 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:50 devstack sudo[83535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:05:50 devstack sudo[83535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:51 devstack sudo[83535]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:51 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:51 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:51 devstack sudo[83538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:05:51 devstack sudo[83538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:52 devstack sudo[83538]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:52 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.692s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:52 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:52 devstack sudo[83541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:05:52 devstack sudo[83541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:52 devstack sudo[83541]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:52 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:52 devstack cinder-volume[82427]: DEBUG cinder.manager [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Notifying Schedulers of capabilities ... {{(pid=82427) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:05:52 devstack cinder-volume[82427]: INFO cinder.volume.manager [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Driver initialization completed successfully. Jun 19 04:05:52 devstack cinder-volume[82427]: INFO cinder.manager [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Initiating service 2 cleanup Jun 19 04:05:53 devstack cinder-volume[82427]: INFO cinder.manager [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Service 2 cleanup completed. Jun 19 04:05:53 devstack cinder-volume[82427]: DEBUG cinder.service [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Creating RPC server for service cinder-volume {{(pid=82427) start /opt/stack/cinder/cinder/service.py:231}} Jun 19 04:05:53 devstack cinder-volume[82427]: DEBUG cinder.service [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82427) start /opt/stack/cinder/cinder/service.py:237}} Jun 19 04:05:53 devstack cinder-volume[82427]: INFO cinder.volume.manager [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 19 04:05:53 devstack cinder-volume[82427]: DEBUG cinder.volume.drivers.lvm [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Updating volume stats {{(pid=82427) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:05:53 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:53 devstack sudo[83545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:05:53 devstack sudo[83545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:53 devstack sudo[83545]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:53 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:53 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:53 devstack sudo[83549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:05:53 devstack sudo[83549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:54 devstack sudo[83549]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:54 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:54 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:54 devstack sudo[83555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:05:54 devstack sudo[83555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:55 devstack sudo[83555]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:55 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.617s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:55 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:05:55 devstack sudo[83612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:05:55 devstack sudo[83612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:05:55 devstack sudo[83612]: pam_unix(sudo:session): session closed for user root Jun 19 04:05:55 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:05:55 devstack cinder-volume[82427]: INFO cinder.volume.manager [None req-b02faa9a-ea7a-4f42-ab59-28c842275297 None None] Driver post RPC initialization completed successfully. Jun 19 04:05:59 devstack cinder-volume[82427]: DEBUG oslo_service.periodic_task [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running periodic task VolumeManager._thread_info {{(pid=82427) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:05:59 devstack cinder-volume[82427]: DEBUG cinder.volume.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] thread count: 6 {{(pid=82427) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:05:59 devstack cinder-volume[82427]: DEBUG cinder.volume.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] thread info: [<_MainThread(MainThread, started 137610897223808)>, , , , , ] {{(pid=82427) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:06:03 devstack cinder-volume[82427]: DEBUG dbcounter [-] [82427] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82427) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:06:05 devstack cinder-volume[82427]: DEBUG dbcounter [-] [82427] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82427) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:06:59 devstack cinder-volume[82427]: DEBUG oslo_service.periodic_task [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82427) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:06:59 devstack cinder-volume[82427]: DEBUG cinder.volume.drivers.lvm [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Updating volume stats {{(pid=82427) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:06:59 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:59 devstack sudo[85362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:06:59 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:07:00 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root Jun 19 04:07:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:07:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:07:00 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:07:00 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:07:00 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Jun 19 04:07:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:07:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:07:00 devstack sudo[85466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:07:00 devstack sudo[85466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:07:01 devstack sudo[85466]: pam_unix(sudo:session): session closed for user root Jun 19 04:07:01 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.623s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:07:01 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:07:01 devstack sudo[85538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:07:01 devstack sudo[85538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:07:02 devstack sudo[85538]: pam_unix(sudo:session): session closed for user root Jun 19 04:07:02 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:07:02 devstack cinder-volume[82427]: DEBUG cinder.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Notifying Schedulers of capabilities ... {{(pid=82427) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:07:02 devstack cinder-volume[82427]: DEBUG oslo_service.periodic_task [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running periodic task VolumeManager._thread_info {{(pid=82427) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:07:02 devstack cinder-volume[82427]: DEBUG cinder.volume.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] thread count: 6 {{(pid=82427) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:07:02 devstack cinder-volume[82427]: DEBUG cinder.volume.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] thread info: [<_MainThread(MainThread, started 137610897223808)>, , , , , ] {{(pid=82427) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:07:59 devstack cinder-volume[82427]: DEBUG oslo_service.periodic_task [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82427) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:07:59 devstack cinder-volume[82427]: DEBUG cinder.volume.drivers.lvm [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Updating volume stats {{(pid=82427) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:07:59 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:07:59 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:07:59 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:08:00 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Jun 19 04:08:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:08:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:08:00 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:08:00 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:08:00 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Jun 19 04:08:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:08:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:08:00 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:08:00 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:08:01 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Jun 19 04:08:01 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.629s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:08:01 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:08:01 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:08:01 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:08:02 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Jun 19 04:08:02 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:08:02 devstack cinder-volume[82427]: DEBUG cinder.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Notifying Schedulers of capabilities ... {{(pid=82427) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:08:02 devstack cinder-volume[82427]: DEBUG oslo_service.periodic_task [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running periodic task VolumeManager._thread_info {{(pid=82427) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:08:02 devstack cinder-volume[82427]: DEBUG cinder.volume.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] thread count: 6 {{(pid=82427) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:08:02 devstack cinder-volume[82427]: DEBUG cinder.volume.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] thread info: [<_MainThread(MainThread, started 137610897223808)>, , , , , ] {{(pid=82427) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:08:05 devstack cinder-volume[82427]: DEBUG dbcounter [-] [82427] Writing DB stats cinder:SELECT=1 {{(pid=82427) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:08:05 devstack cinder-volume[82427]: DEBUG dbcounter [-] [82427] Writing DB stats cinder:UPDATE=1 {{(pid=82427) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:08:59 devstack cinder-volume[82427]: DEBUG oslo_service.periodic_task [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82427) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:08:59 devstack cinder-volume[82427]: DEBUG cinder.volume.drivers.lvm [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Updating volume stats {{(pid=82427) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:08:59 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:08:59 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:08:59 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:09:00 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Jun 19 04:09:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:09:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:09:00 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:09:00 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:09:00 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Jun 19 04:09:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:09:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:09:00 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:09:00 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:09:01 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Jun 19 04:09:01 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.644s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:09:01 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:09:01 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:09:01 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:09:02 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Jun 19 04:09:02 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:09:02 devstack cinder-volume[82427]: DEBUG cinder.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Notifying Schedulers of capabilities ... {{(pid=82427) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:09:02 devstack cinder-volume[82427]: DEBUG oslo_service.periodic_task [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running periodic task VolumeManager._thread_info {{(pid=82427) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:09:02 devstack cinder-volume[82427]: DEBUG cinder.volume.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] thread count: 6 {{(pid=82427) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:09:02 devstack cinder-volume[82427]: DEBUG cinder.volume.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] thread info: [<_MainThread(MainThread, started 137610897223808)>, , , , , ] {{(pid=82427) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:09:59 devstack cinder-volume[82427]: DEBUG oslo_service.periodic_task [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82427) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:09:59 devstack cinder-volume[82427]: DEBUG cinder.volume.drivers.lvm [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Updating volume stats {{(pid=82427) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:09:59 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:09:59 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:09:59 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:00 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:00 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:10:00 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:00 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:00 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:00 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:10:00 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:01 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:01 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:01 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:01 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:10:01 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:02 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:02 devstack cinder-volume[82427]: DEBUG oslo_concurrency.processutils [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=82427) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:02 devstack cinder-volume[82427]: DEBUG cinder.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Notifying Schedulers of capabilities ... {{(pid=82427) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:10:02 devstack cinder-volume[82427]: DEBUG oslo_service.periodic_task [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] Running periodic task VolumeManager._thread_info {{(pid=82427) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:10:02 devstack cinder-volume[82427]: DEBUG cinder.volume.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] thread count: 6 {{(pid=82427) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:10:02 devstack cinder-volume[82427]: DEBUG cinder.volume.manager [None req-44e6a3ce-0c04-4457-8aa2-39942365aff6 None None] thread info: [<_MainThread(MainThread, started 137610897223808)>, , , , , ] {{(pid=82427) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:10:05 devstack cinder-volume[82427]: DEBUG dbcounter [-] [82427] Writing DB stats cinder:SELECT=1 {{(pid=82427) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:10:05 devstack cinder-volume[82427]: DEBUG dbcounter [-] [82427] Writing DB stats cinder:UPDATE=1 {{(pid=82427) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:10:31 devstack cinder-volume[82267]: INFO oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Caught SIGTERM, stopping children Jun 19 04:10:31 devstack cinder-volume[82267]: DEBUG oslo_concurrency.lockutils [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Acquiring lock "singleton_lock" {{(pid=82267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:10:31 devstack cinder-volume[82267]: DEBUG oslo_concurrency.lockutils [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Acquired lock "singleton_lock" {{(pid=82267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:10:31 devstack cinder-volume[82267]: DEBUG oslo_concurrency.lockutils [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Releasing lock "singleton_lock" {{(pid=82267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:10:31 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Stop services. {{(pid=82267) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 19 04:10:31 devstack cinder-volume[82267]: DEBUG oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Killing children. {{(pid=82267) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 19 04:10:31 devstack cinder-volume[82267]: INFO oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Waiting on 1 children to exit Jun 19 04:10:33 devstack cinder-volume[82427]: DEBUG oslo_concurrency.lockutils [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Acquiring lock "singleton_lock" {{(pid=82427) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:10:33 devstack cinder-volume[82427]: DEBUG oslo_concurrency.lockutils [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Acquired lock "singleton_lock" {{(pid=82427) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:10:33 devstack cinder-volume[82427]: DEBUG oslo_concurrency.lockutils [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Releasing lock "singleton_lock" {{(pid=82427) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:10:33 devstack cinder-volume[82427]: WARNING amqp [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 04:10:33 devstack cinder-volume[82427]: WARNING amqp [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 04:10:33 devstack cinder-volume[82267]: INFO oslo_service.backend._eventlet.service [None req-c1024c46-fcde-4690-b500-5429d466c9d8 None None] Child 82427 exited with status 0 Jun 19 04:10:33 devstack cinder-volume[92530]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 19 04:10:33 devstack cinder-volume[92530]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:10:33 devstack cinder-volume[92530]: we strongly recommend against using it for new projects. Jun 19 04:10:33 devstack cinder-volume[92530]: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:10:33 devstack cinder-volume[92530]: framework. For more detail see Jun 19 04:10:33 devstack cinder-volume[92530]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:10:33 devstack cinder-volume[92530]: import eventlet # noqa Jun 19 04:10:35 devstack cinder-volume[92530]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:10:35 devstack cinder-volume[92530]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:10:35 devstack cinder-volume[92530]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:10:36 devstack cinder-volume[92530]: INFO dbcounter [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Registered counter for database cinder Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_db.sqlalchemy.engines [None req-32361644-e129-474a-b758-c3390d51fb60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92530) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG dbcounter [-] [92530] Writer thread running {{(pid=92530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:10:36 devstack cinder-volume[92530]: INFO cinder.rpc [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 19 04:10:36 devstack cinder-volume[92530]: INFO cinder.rpc [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_db.sqlalchemy.engines [None req-32361644-e129-474a-b758-c3390d51fb60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92530) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:10:36 devstack cinder-volume[92530]: INFO cinder.volume.manager [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Determined volume DB was empty at startup. Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG cinder.volume.manager [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92530) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 19 04:10:36 devstack cinder-volume[92530]: INFO cinder.volume.manager [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 19 04:10:36 devstack cinder-volume[92530]: WARNING stevedore.named [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 04:10:36 devstack cinder-volume[92530]: WARNING castellan.key_manager [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:10:36 devstack cinder-volume[92530]: WARNING cinder.keymgr.conf_key_mgr [None req-32361644-e129-474a-b758-c3390d51fb60 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:10:36 devstack cinder-volume[92530]: INFO cinder.volume.manager [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_db.sqlalchemy.engines [None req-32361644-e129-474a-b758-c3390d51fb60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92530) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:10:36 devstack cinder-volume[92530]: INFO oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Starting 1 workers Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Started child 92745 {{(pid=92530) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Full set of CONF: {{(pid=92530) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] ******************************************************************************** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Configuration options gathered from: {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] ================================================================================ {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] allow_availability_zone_fallback = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] allow_compression_on_image_upload = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92745]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] allowed_direct_url_schemes = [] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] api_rate_limit = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] auth_strategy = keystone {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_availability_zone = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_host = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_name = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_stats_polling_interval = 60 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backup_api_class = cinder.backup.api.API {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backup_name_template = backup-%s {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backup_use_same_host = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backup_use_temp_snapshot = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] chap_password = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] chap_username = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cinder_internal_tenant_project_id = 9c4d96b1465343faa40cb4a087e6cdde {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cinder_internal_tenant_user_id = 7a6ade5971ca49c1a39d94d7f47279f2 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cluster = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] compression_format = gzip {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] compute_api_class = cinder.compute.nova.API {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] config_dir = [] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] config_source = [] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] control_exchange = openstack {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] debug = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] default_availability_zone = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] default_group_type = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] default_volume_type = QuobyteHD {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] disk_geometry = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] driver_client_cert = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] driver_client_cert_key = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] driver_data_namespace = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] driver_ssl_cert_path = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] driver_ssl_cert_verify = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] driver_use_ssl = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] enable_new_services = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] enable_unsupported_driver = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] enabled_backends = ['QuobyteHD'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] enforce_multipath_for_image_xfer = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] filter_function = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance_api_insecure = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance_api_servers = ['http://192.168.122.126/image'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance_api_ssl_compression = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance_ca_certificates_file = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance_catalog_info = image:glance:publicURL {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance_certfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance_keyfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance_num_retries = 3 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance_request_timeout = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] goodness_function = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] graceful_shutdown_timeout = 5 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] group_api_class = cinder.group.api.API {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] host = devstack {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] image_compress_on_upload = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] image_conversion_address_space_limit = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] image_conversion_cpu_limit = 60 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] image_conversion_disable = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] image_upload_use_cinder_backend = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] image_upload_use_internal_tenant = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] image_volume_cache_enabled = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92745]: INFO cinder.volume.manager [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 19 04:10:36 devstack cinder-volume[92745]: DEBUG cinder.volume.drivers.remotefs [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92745) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] image_volume_cache_max_count = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] image_volume_cache_max_size_gb = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] init_host_max_objects_retrieval = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] instance_format = [instance: %(uuid)s] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] iscsi_target_flags = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] iscsi_write_cache = on {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] iser_helper = tgtadm {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] iser_ip_address = 192.168.122.126 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] iser_port = 3260 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] log_color = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] log_config_append = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] log_dir = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] log_file = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] log_options = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] log_rotate_interval = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] log_rotate_interval_type = days {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] log_rotation_type = none {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] max_age = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] max_logfile_count = 30 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] max_logfile_size_mb = 200 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] max_over_subscription_ratio = 20.0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] message_reap_interval = 86400 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] message_ttl = 2592000 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] migration_create_volume_timeout_secs = 300 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] monkey_patch = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] monkey_patch_modules = [] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] my_ip = 192.168.122.126 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] no_snapshot_gb_quota = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] num_iser_scan_tries = 3 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] num_shell_tries = 3 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] num_volume_device_scan_tries = 3 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] nvmeof_conn_info_version = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] nvmet_ns_id = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] nvmet_port_id = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] osapi_max_limit = 1000 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] osapi_volume_ext_list = [] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] osapi_volume_listen_port = 8776 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] osapi_volume_use_ssl = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] osapi_volume_workers = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] per_volume_size_limit = -1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] periodic_fuzzy_delay = 60 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] periodic_interval = 60 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] public_endpoint = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] publish_errors = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] quota_backup_gigabytes = 1000 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] quota_backups = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] quota_gigabytes = 1000 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] quota_groups = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] quota_snapshots = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] quota_volumes = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] rate_limit_burst = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] rate_limit_except_level = CRITICAL {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] rate_limit_interval = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] reinit_driver_count = 3 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] replication_device = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] report_discard_supported = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] report_interval = 120 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] reservation_clean_interval = 86400 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] reservation_expire = 86400 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] reserved_image_namespaces = [] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] reserved_percentage = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] rpc_response_timeout = 120 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] run_external_periodic_tasks = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] scst_target_driver = iscsi {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] scst_target_iqn_name = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] service_down_time = 720 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] shell_completion = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] snapshot_name_template = snapshot-%s {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] split_loggers = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] state_path = /opt/stack/data/cinder {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] storage_availability_zone = nova {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] storage_protocol = iSCSI {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] syslog_log_facility = LOG_USER {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] target_helper = lioadm {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] target_ip_address = 192.168.122.126 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] target_port = 3260 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] target_protocol = iscsi {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] target_secondary_ip_addresses = [] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] trace_flags = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:36 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] transport_url = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] until_refresh = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] use_chap_auth = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] use_default_quota_class = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] use_journal = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] use_json = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] use_multipath_for_image_xfer = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] use_stderr = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] use_syslog = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] verify_glance_signatures = enabled {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92745]: DEBUG cinder.volume.drivers.quobyte [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92745) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 19 04:10:37 devstack cinder-volume[92745]: WARNING cinder.volume.drivers.quobyte [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 19 04:10:37 devstack cinder-volume[92745]: WARNING cinder.volume.drivers.quobyte [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 19 04:10:37 devstack cinder-volume[92745]: DEBUG oslo_concurrency.processutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Running cmd (subprocess): mount.quobyte {{(pid=92745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] volume_api_class = cinder.volume.api.API {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] volume_backend_name = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] volume_clear = zero {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] volume_clear_ionice = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] volume_clear_size = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] volume_copy_bps_limit = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] volume_dd_blocksize = 1M {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] volume_name_template = volume-%s {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] volume_service_inithost_offload = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] volume_usage_audit_period = month {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] zoning_mode = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_concurrency.disable_process_locking = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.auth_section = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.auth_type = password {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.auth_version = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.cache = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.certfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.include_service_catalog = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.insecure = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.interface = public {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.keyfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_password = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcache_username = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.region_name = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.service_type = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.126/identity {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.backend = dogpile.cache.null {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.backend_argument = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.backend_expiration_time = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.config_prefix = cache.oslo {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.debug_cache_backend = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.enable_retry_client = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.enable_socket_keepalive = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.enabled = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.expiration_time = 600 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.hashclient_retry_attempts = 2 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.memcache_dead_retry = 300 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.memcache_pool_maxsize = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.memcache_sasl_enabled = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.password = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.proxies = [] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.redis_db = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.redis_server = localhost:6379 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.retry_attempts = 2 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.retry_delay = 0.0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.socket_keepalive_count = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.socket_keepalive_idle = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.socket_keepalive_interval = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.socket_timeout = 1.0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.tls_allowed_ciphers = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.tls_cafile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.tls_certfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.tls_enabled = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.tls_keyfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cache.username = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] coordination.backend_url = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.asyncio_connection = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.asyncio_slave_connection = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.backend = sqlalchemy {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.connection = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.connection_debug = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.connection_parameters = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.connection_recycle_time = 3600 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.connection_trace = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.db_inc_retry_interval = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.db_max_retries = 20 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.db_max_retry_interval = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.db_retry_interval = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.max_overflow = 50 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.max_pool_size = 5 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.max_retries = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.mysql_wsrep_sync_wait = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.pool_timeout = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.retry_interval = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.slave_connection = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.sqlite_synchronous = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.synchronous_reader = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack quobyte-client[92746]: Reading configuration file: /etc/quobyte/client.cfg Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] database.use_db_reconnect = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack quobyte-client[92746]: Invalid parameters found, error: missing mount point. Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler.connection_string = messaging:// {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler.enabled = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler.es_doc_type = notification {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler.es_scroll_size = 10000 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler.es_scroll_time = 2m {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler.filter_error_trace = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler.hmac_keys = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack quobyte-client[92746]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler.sentinel_service_name = mymaster {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler.socket_timeout = 0.1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler.trace_requests = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler.trace_sqlalchemy = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler_jaeger.process_tags = {} {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler_jaeger.service_name_prefix = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] profiler_otlp.service_name_prefix = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack quobyte-client[92746]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 19 04:10:37 devstack cinder-volume[92745]: DEBUG oslo_concurrency.processutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] CMD "mount.quobyte" returned: 1 in 0.094s {{(pid=92745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:37 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:10:37 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:10:37 devstack cinder-volume[92745]: DEBUG cinder.volume.drivers.quobyte [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=92745) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:10:37 devstack cinder-volume[92745]: INFO cinder.volume.drivers.quobyte [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b ... Jun 19 04:10:37 devstack cinder-volume[92745]: DEBUG oslo_concurrency.processutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b -c /etc/quobyte/client-cinder.cfg {{(pid=92745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_policy.enforce_new_defaults = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: WARNING oslo_config.cfg [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_policy.enforce_scope = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_policy.policy_default_rule = default {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_policy.policy_file = policy.yaml {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] privsep_osbrick.group = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] privsep_osbrick.helper_command = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] privsep_osbrick.user = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cinder_sys_admin.group = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cinder_sys_admin.helper_command = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] cinder_sys_admin.user = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] service_user.auth_section = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] service_user.auth_type = password {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] service_user.cafile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] service_user.certfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] service_user.collect_timing = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] service_user.insecure = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b -c /etc/quobyte/client-cinder.cfg Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] service_user.keyfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] service_user.send_service_user_token = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] service_user.split_loggers = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] service_user.timeout = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance.auth_section = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance.auth_type = password {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance.certfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance.collect_timing = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance.insecure = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance.keyfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance.region_name = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance.split_loggers = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] glance.timeout = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.backend_availability_zone = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.chap_password = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.chap_username = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.disk_geometry = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.driver_client_cert = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.driver_client_cert_key = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.driver_data_namespace = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.driver_use_ssl = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.extra_capabilities = {} {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.filter_function = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.goodness_function = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.iscsi_target_flags = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.iscsi_write_cache = on {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.iser_helper = tgtadm {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.iser_ip_address = 192.168.122.126 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.iser_port = 3260 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.nas_host = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.nas_login = admin {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.nas_mount_options = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.nas_password = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.nas_private_key = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.nas_share_path = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.num_shell_tries = 3 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.quobyte_volume_url = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.replication_device = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.report_discard_supported = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.reserved_percentage = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.target_helper = tgtadm {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.target_ip_address = 192.168.122.126 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.target_port = 3260 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.target_protocol = iscsi {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.trace_flags = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.unique_fqdn_network = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.use_chap_auth = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.volume_backend_name = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.volume_clear = zero {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.volume_clear_ionice = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.volume_clear_size = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_reports.file_event_handler = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_reports.log_dir = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.backend_availability_zone = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.backend_host = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.chap_password = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.chap_username = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.chiscsi_conf = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.disk_geometry = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.driver_client_cert = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.driver_data_namespace = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.driver_use_ssl = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.extra_capabilities = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.filter_function = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.goodness_function = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.iser_helper = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.iser_ip_address = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.iser_port = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.iser_target_prefix = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.nas_host = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.nas_login = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.nas_mount_options = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.nas_password = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.nas_private_key = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.nas_share_path = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.nas_ssh_port = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.num_shell_tries = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.nvmet_port_id = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.replication_device = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.report_discard_supported = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.reserved_percentage = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.scst_target_driver = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.storage_protocol = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.target_helper = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.target_ip_address = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.target_port = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.target_prefix = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.target_protocol = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.trace_flags = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.use_chap_auth = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.volume_clear = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.volume_clear_size = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] QuobyteHD.volumes_dir = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.ssl = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_notifications.driver = [] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_notifications.retry = -1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] key_manager.fixed_key = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.barbican_api_version = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.barbican_endpoint = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.barbican_endpoint_type = public {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.barbican_region_name = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.cafile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.certfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.collect_timing = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.insecure = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.keyfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.number_of_retries = 60 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.retry_delay = 1 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.send_service_user_token = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.split_loggers = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.timeout = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.verify_ssl = True {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican.verify_ssl_path = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican_service_user.auth_section = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican_service_user.auth_type = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican_service_user.cafile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican_service_user.certfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican_service_user.collect_timing = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican_service_user.insecure = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican_service_user.keyfile = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican_service_user.split_loggers = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] barbican_service_user.timeout = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] vault.approle_role_id = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] vault.approle_secret_id = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] vault.kv_mountpoint = secret {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] vault.kv_path = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] vault.kv_version = 2 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] vault.namespace = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] vault.root_token_id = **** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] vault.ssl_ca_crt_file = None {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] vault.timeout = 60.0 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] vault.use_ssl = False {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:37 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] ******************************************************************************** {{(pid=92530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 19 04:10:37 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:37 devstack cinder-volume[92745]: DEBUG oslo_concurrency.processutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.751s {{(pid=92745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:37 devstack cinder-volume[92745]: INFO cinder.volume.drivers.quobyte [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b succeeded Jun 19 04:10:37 devstack cinder-volume[92745]: DEBUG cinder.volume.drivers.quobyte [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=92745) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:10:37 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.764s {{(pid=92745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:10:37 devstack cinder-volume[92745]: DEBUG oslo_concurrency.processutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=92745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:37 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:10:37 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:38 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:38 devstack cinder-volume[92745]: DEBUG oslo_concurrency.processutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.590s {{(pid=92745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:38 devstack cinder-volume[92745]: INFO cinder.volume.driver [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Driver hasn't implemented _init_vendor_properties() Jun 19 04:10:38 devstack cinder-volume[92745]: DEBUG cinder.volume.driver [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578201293945, 'free_capacity_gb': 1775.7578201293945, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92745) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 19 04:10:38 devstack cinder-volume[92745]: DEBUG oslo_db.sqlalchemy.engines [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92745) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:10:38 devstack cinder-volume[92745]: DEBUG dbcounter [-] [92745] Writer thread running {{(pid=92745) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:10:38 devstack cinder-volume[92745]: DEBUG cinder.db.api [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Building query based on filter {{(pid=92745) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 19 04:10:38 devstack cinder-volume[92745]: DEBUG cinder.image.image_utils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92745) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 19 04:10:38 devstack cinder-volume[92745]: INFO cinder.keymgr.migration [None req-77b3799f-e6de-4385-a9ca-efa41d6c16b2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 19 04:10:38 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:10:38 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:10:38 devstack cinder-volume[92745]: DEBUG cinder.volume.drivers.quobyte [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=92745) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:10:38 devstack cinder-volume[92745]: DEBUG cinder.volume.drivers.quobyte [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=92745) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:10:38 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:10:38 devstack cinder-volume[92745]: DEBUG oslo_concurrency.processutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=92745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:38 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:10:38 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:39 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:39 devstack cinder-volume[92745]: DEBUG oslo_concurrency.processutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.607s {{(pid=92745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:39 devstack cinder-volume[92745]: DEBUG cinder.manager [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Notifying Schedulers of capabilities ... {{(pid=92745) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:10:39 devstack cinder-volume[92745]: INFO cinder.volume.manager [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Driver initialization completed successfully. Jun 19 04:10:39 devstack cinder-volume[92745]: INFO cinder.manager [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Initiating service 3 cleanup Jun 19 04:10:39 devstack cinder-volume[92745]: INFO cinder.manager [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Service 3 cleanup completed. Jun 19 04:10:39 devstack cinder-volume[92745]: DEBUG cinder.service [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Creating RPC server for service cinder-volume {{(pid=92745) start /opt/stack/cinder/cinder/service.py:231}} Jun 19 04:10:39 devstack cinder-volume[92745]: DEBUG cinder.service [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92745) start /opt/stack/cinder/cinder/service.py:237}} Jun 19 04:10:39 devstack cinder-volume[92745]: INFO cinder.volume.manager [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 19 04:10:39 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:10:39 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:10:39 devstack cinder-volume[92745]: DEBUG cinder.volume.drivers.quobyte [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=92745) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:10:39 devstack cinder-volume[92745]: DEBUG cinder.volume.drivers.quobyte [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=92745) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:10:39 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:10:39 devstack cinder-volume[92745]: DEBUG oslo_concurrency.processutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=92745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:39 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:10:39 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:40 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:40 devstack cinder-volume[92745]: DEBUG oslo_concurrency.processutils [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.632s {{(pid=92745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:40 devstack cinder-volume[92745]: INFO cinder.volume.manager [None req-99938e48-dae0-4397-9a12-912992e91cb2 None None] Driver post RPC initialization completed successfully. Jun 19 04:10:44 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-0d4c1a8e-b5e2-41eb-b236-a481dbcb1c03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:10:44 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-0d4c1a8e-b5e2-41eb-b236-a481dbcb1c03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:10:44 devstack cinder-volume[92745]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c1a8e-b5e2-41eb-b236-a481dbcb1c03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=92745) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:10:44 devstack cinder-volume[92745]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c1a8e-b5e2-41eb-b236-a481dbcb1c03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=92745) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:10:44 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-0d4c1a8e-b5e2-41eb-b236-a481dbcb1c03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:10:44 devstack cinder-volume[92745]: DEBUG oslo_concurrency.processutils [None req-0d4c1a8e-b5e2-41eb-b236-a481dbcb1c03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=92745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:44 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:10:44 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:45 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:45 devstack cinder-volume[92745]: DEBUG oslo_concurrency.processutils [None req-0d4c1a8e-b5e2-41eb-b236-a481dbcb1c03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.631s {{(pid=92745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:45 devstack cinder-volume[92745]: DEBUG cinder.manager [None req-0d4c1a8e-b5e2-41eb-b236-a481dbcb1c03 None None] Notifying Schedulers of capabilities ... {{(pid=92745) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:10:46 devstack cinder-volume[92530]: DEBUG dbcounter [-] [92530] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:10:47 devstack cinder-volume[92745]: DEBUG oslo_service.periodic_task [None req-57980bd6-637f-45f0-b78b-b0a5d2dba67f None None] Running periodic task VolumeManager._thread_info {{(pid=92745) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:10:47 devstack cinder-volume[92745]: DEBUG cinder.volume.manager [None req-57980bd6-637f-45f0-b78b-b0a5d2dba67f None None] thread count: 6 {{(pid=92745) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:10:47 devstack cinder-volume[92745]: DEBUG cinder.volume.manager [None req-57980bd6-637f-45f0-b78b-b0a5d2dba67f None None] thread info: [<_MainThread(MainThread, started 139603379667072)>, , , , , ] {{(pid=92745) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:10:47 devstack cinder-volume[92530]: INFO oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Caught SIGTERM, stopping children Jun 19 04:10:47 devstack cinder-volume[92530]: DEBUG oslo_concurrency.lockutils [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Acquiring lock "singleton_lock" {{(pid=92530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:10:47 devstack cinder-volume[92530]: DEBUG oslo_concurrency.lockutils [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Acquired lock "singleton_lock" {{(pid=92530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:10:47 devstack cinder-volume[92530]: DEBUG oslo_concurrency.lockutils [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Releasing lock "singleton_lock" {{(pid=92530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:10:47 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Stop services. {{(pid=92530) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 19 04:10:47 devstack cinder-volume[92530]: DEBUG oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Killing children. {{(pid=92530) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 19 04:10:47 devstack cinder-volume[92530]: INFO oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Waiting on 1 children to exit Jun 19 04:10:50 devstack cinder-volume[92745]: DEBUG dbcounter [-] [92745] Writing DB stats cinder:SELECT=4 {{(pid=92745) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:10:50 devstack cinder-volume[92745]: DEBUG dbcounter [-] [92745] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=92745) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:10:52 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Acquiring lock "singleton_lock" {{(pid=92745) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:10:52 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Acquired lock "singleton_lock" {{(pid=92745) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:10:52 devstack cinder-volume[92745]: DEBUG oslo_concurrency.lockutils [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Releasing lock "singleton_lock" {{(pid=92745) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:10:52 devstack cinder-volume[92745]: WARNING amqp [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 04:10:52 devstack cinder-volume[92745]: WARNING amqp [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 04:10:52 devstack cinder-volume[92530]: INFO oslo_service.backend._eventlet.service [None req-32361644-e129-474a-b758-c3390d51fb60 None None] Child 92745 exited with status 0 Jun 19 04:10:53 devstack cinder-volume[93034]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 19 04:10:53 devstack cinder-volume[93034]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:10:53 devstack cinder-volume[93034]: we strongly recommend against using it for new projects. Jun 19 04:10:53 devstack cinder-volume[93034]: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:10:53 devstack cinder-volume[93034]: framework. For more detail see Jun 19 04:10:53 devstack cinder-volume[93034]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:10:53 devstack cinder-volume[93034]: import eventlet # noqa Jun 19 04:10:55 devstack cinder-volume[93034]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93034) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:10:55 devstack cinder-volume[93034]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93034) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:10:55 devstack cinder-volume[93034]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93034) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:10:56 devstack cinder-volume[93034]: INFO dbcounter [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] Registered counter for database cinder Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_db.sqlalchemy.engines [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93034) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG dbcounter [-] [93034] Writer thread running {{(pid=93034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:10:56 devstack cinder-volume[93034]: INFO cinder.rpc [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 19 04:10:56 devstack cinder-volume[93034]: INFO cinder.rpc [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_db.sqlalchemy.engines [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93034) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:10:56 devstack cinder-volume[93034]: INFO cinder.volume.manager [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] Determined volume DB was empty at startup. Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG cinder.volume.manager [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93034) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 19 04:10:56 devstack cinder-volume[93034]: WARNING stevedore.named [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 04:10:56 devstack cinder-volume[93034]: WARNING castellan.key_manager [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:10:56 devstack cinder-volume[93034]: WARNING cinder.keymgr.conf_key_mgr [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:10:56 devstack cinder-volume[93034]: INFO cinder.volume.manager [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_db.sqlalchemy.engines [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93034) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:10:56 devstack cinder-volume[93034]: INFO oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] Starting 1 workers Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] Started child 93300 {{(pid=93034) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] Full set of CONF: {{(pid=93034) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] ******************************************************************************** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] Configuration options gathered from: {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] ================================================================================ {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] allow_availability_zone_fallback = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93300]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] allow_compression_on_image_upload = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] allowed_direct_url_schemes = [] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] api_rate_limit = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] auth_strategy = keystone {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_availability_zone = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_host = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_name = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_stats_polling_interval = 60 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backup_api_class = cinder.backup.api.API {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backup_name_template = backup-%s {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backup_use_same_host = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backup_use_temp_snapshot = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] chap_password = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] chap_username = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cinder_internal_tenant_project_id = 9c4d96b1465343faa40cb4a087e6cdde {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cinder_internal_tenant_user_id = 7a6ade5971ca49c1a39d94d7f47279f2 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cluster = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] compression_format = gzip {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] compute_api_class = cinder.compute.nova.API {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] config_dir = [] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] config_source = [] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] control_exchange = openstack {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] debug = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] default_availability_zone = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] default_group_type = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] default_volume_type = QuobyteHD {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] disk_geometry = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] driver_client_cert = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] driver_client_cert_key = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] driver_data_namespace = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] driver_ssl_cert_path = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] driver_ssl_cert_verify = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] driver_use_ssl = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] enable_new_services = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] enable_unsupported_driver = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] enabled_backends = ['QuobyteHD'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] enforce_multipath_for_image_xfer = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] filter_function = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance_api_insecure = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance_api_servers = ['http://192.168.122.126/image'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance_api_ssl_compression = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance_ca_certificates_file = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance_catalog_info = image:glance:publicURL {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance_certfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance_keyfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance_num_retries = 3 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance_request_timeout = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] goodness_function = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] graceful_shutdown_timeout = 5 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] group_api_class = cinder.group.api.API {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] host = devstack {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] image_compress_on_upload = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] image_conversion_address_space_limit = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] image_conversion_cpu_limit = 60 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] image_conversion_disable = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] image_upload_use_cinder_backend = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] image_upload_use_internal_tenant = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] image_volume_cache_enabled = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] image_volume_cache_max_count = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] image_volume_cache_max_size_gb = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] init_host_max_objects_retrieval = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] instance_format = [instance: %(uuid)s] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] iscsi_target_flags = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] iscsi_write_cache = on {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] iser_helper = tgtadm {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] iser_ip_address = 192.168.122.126 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] iser_port = 3260 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] log_color = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Starting volume driver QuobyteDriver (1.1.14) Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] log_config_append = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93300) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] log_dir = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] log_file = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] log_options = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] log_rotate_interval = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] log_rotate_interval_type = days {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] log_rotation_type = none {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] max_age = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] max_logfile_count = 30 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] max_logfile_size_mb = 200 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] max_over_subscription_ratio = 20.0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] message_reap_interval = 86400 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] message_ttl = 2592000 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] migration_create_volume_timeout_secs = 300 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] monkey_patch = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] monkey_patch_modules = [] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] my_ip = 192.168.122.126 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] no_snapshot_gb_quota = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] num_iser_scan_tries = 3 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] num_shell_tries = 3 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] num_volume_device_scan_tries = 3 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] nvmeof_conn_info_version = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] nvmet_ns_id = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] nvmet_port_id = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] osapi_max_limit = 1000 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] osapi_volume_ext_list = [] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] osapi_volume_listen = 0.0.0.0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] osapi_volume_listen_port = 8776 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] osapi_volume_use_ssl = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] osapi_volume_workers = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] per_volume_size_limit = -1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] periodic_fuzzy_delay = 60 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] periodic_interval = 60 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] project_id_regex = [0-9a-f\-]+ {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] public_endpoint = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] publish_errors = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] quota_backup_gigabytes = 1000 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] quota_backups = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] quota_gigabytes = 1000 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] quota_groups = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] quota_snapshots = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] quota_volumes = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] rate_limit_burst = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] rate_limit_except_level = CRITICAL {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] rate_limit_interval = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] reinit_driver_count = 3 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] replication_device = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] report_discard_supported = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] report_interval = 120 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] reservation_clean_interval = 86400 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] reservation_expire = 86400 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] reserved_image_namespaces = [] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] reserved_percentage = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] rpc_response_timeout = 120 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] run_external_periodic_tasks = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] scst_target_driver = iscsi {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] scst_target_iqn_name = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] service_down_time = 720 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] shell_completion = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] snapshot_name_template = snapshot-%s {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] split_loggers = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] state_path = /opt/stack/data/cinder {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] storage_availability_zone = nova {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] storage_protocol = iSCSI {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] syslog_log_facility = LOG_USER {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] target_helper = lioadm {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] target_ip_address = 192.168.122.126 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] target_port = 3260 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] target_protocol = iscsi {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] target_secondary_ip_addresses = [] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] trace_flags = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] transfer_api_class = cinder.transfer.api.API {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] transport_url = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] until_refresh = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] use_chap_auth = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] use_default_quota_class = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] use_journal = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] use_json = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] use_multipath_for_image_xfer = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] use_stderr = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] use_syslog = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] verify_glance_signatures = enabled {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] volume_api_class = cinder.volume.api.API {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] volume_backend_name = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] volume_clear = zero {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] volume_clear_ionice = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] volume_clear_size = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] volume_copy_bps_limit = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] volume_dd_blocksize = 1M {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] volume_name_template = volume-%s {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] volume_service_inithost_offload = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] volume_usage_audit_period = month {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] zoning_mode = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_concurrency.disable_process_locking = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.auth_section = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.auth_type = password {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.auth_version = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.cache = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.certfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.delay_auth_decision = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.http_connect_timeout = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.include_service_catalog = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.insecure = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.interface = public {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.keyfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_password = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcache_username = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.region_name = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.service_token_roles_required = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.service_type = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.token_cache_time = 300 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.126/identity {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.backend = dogpile.cache.null {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.backend_argument = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.backend_expiration_time = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.config_prefix = cache.oslo {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.debug_cache_backend = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.enable_retry_client = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.enable_socket_keepalive = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.enabled = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.expiration_time = 600 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.hashclient_retry_attempts = 2 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.memcache_dead_retry = 300 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.memcache_pool_maxsize = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.memcache_sasl_enabled = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.password = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.proxies = [] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.redis_db = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.redis_sentinel_service_name = mymaster {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.redis_server = localhost:6379 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.retry_attempts = 2 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.retry_delay = 0.0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.socket_keepalive_count = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.socket_keepalive_idle = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.socket_keepalive_interval = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.socket_timeout = 1.0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.tls_allowed_ciphers = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.tls_cafile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.tls_certfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.tls_enabled = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.tls_keyfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cache.username = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] coordination.backend_url = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.asyncio_connection = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.asyncio_slave_connection = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.backend = sqlalchemy {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.connection = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.connection_debug = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.connection_parameters = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.connection_recycle_time = 3600 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.connection_trace = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.db_inc_retry_interval = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.db_max_retries = 20 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.db_max_retry_interval = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.db_retry_interval = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93300) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.max_overflow = 50 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.quobyte [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.max_pool_size = 5 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.quobyte [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.max_retries = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.mysql_wsrep_sync_wait = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.pool_timeout = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.retry_interval = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.slave_connection = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.sqlite_synchronous = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.synchronous_reader = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] database.use_db_reconnect = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Running cmd (subprocess): mount.quobyte {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler.connection_string = messaging:// {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler.enabled = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler.es_doc_type = notification {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler.es_scroll_size = 10000 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler.es_scroll_time = 2m {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler.filter_error_trace = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler.hmac_keys = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler.sentinel_service_name = mymaster {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler.socket_timeout = 0.1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler.trace_requests = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler.trace_sqlalchemy = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler_jaeger.process_tags = {} {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler_jaeger.service_name_prefix = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] profiler_otlp.service_name_prefix = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_policy.enforce_new_defaults = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: WARNING oslo_config.cfg [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_policy.enforce_scope = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_policy.policy_default_rule = default {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_policy.policy_file = policy.yaml {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_policy.remote_timeout = 60.0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] privsep_osbrick.group = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] privsep_osbrick.helper_command = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] privsep_osbrick.user = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cinder_sys_admin.group = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cinder_sys_admin.helper_command = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] cinder_sys_admin.user = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] service_user.auth_section = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] service_user.auth_type = password {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] service_user.cafile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] service_user.certfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] service_user.collect_timing = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] service_user.insecure = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] service_user.keyfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] service_user.send_service_user_token = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] service_user.split_loggers = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] service_user.timeout = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance.auth_section = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance.auth_type = password {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance.certfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance.collect_timing = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance.insecure = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance.keyfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance.region_name = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance.split_loggers = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] glance.timeout = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.backend_availability_zone = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.chap_password = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.chap_username = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.disk_geometry = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.driver_client_cert = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.driver_client_cert_key = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.driver_data_namespace = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.driver_use_ssl = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.enable_unsupported_driver = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.extra_capabilities = {} {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.filter_function = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.goodness_function = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.iscsi_target_flags = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.iscsi_write_cache = on {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.iser_helper = tgtadm {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.iser_ip_address = 192.168.122.126 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.iser_port = 3260 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.nas_host = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.nas_login = admin {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.nas_mount_options = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.nas_password = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.nas_private_key = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.nas_share_path = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.nas_ssh_port = 22 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.num_shell_tries = 3 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.nvmet_port_id = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.quobyte_client_cfg = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.quobyte_volume_url = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.replication_device = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.report_discard_supported = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.reserved_percentage = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.scst_target_driver = iscsi {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.scst_target_iqn_name = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.storage_protocol = iSCSI {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.target_helper = tgtadm {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.target_ip_address = 192.168.122.126 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.target_port = 3260 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.target_protocol = iscsi {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.trace_flags = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.unique_fqdn_network = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.use_chap_auth = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.volume_backend_name = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.volume_clear = zero {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.volume_clear_ionice = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.volume_clear_size = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_reports.file_event_handler = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_reports.log_dir = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.backend_availability_zone = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.backend_host = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.chap_password = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.chap_username = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.chiscsi_conf = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.disk_geometry = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.driver_client_cert = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.driver_client_cert_key = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.driver_data_namespace = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.driver_use_ssl = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.extra_capabilities = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.filter_function = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.goodness_function = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.iscsi_target_flags = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.iscsi_write_cache = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack quobyte-client[93313]: Reading configuration file: /etc/quobyte/client.cfg Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.iser_helper = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.iser_ip_address = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.iser_port = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.iser_target_prefix = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack quobyte-client[93313]: Invalid parameters found, error: missing mount point. Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.nas_host = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.nas_login = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.nas_mount_options = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.nas_password = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.nas_private_key = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack quobyte-client[93313]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.nas_share_path = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.nas_ssh_port = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack quobyte-client[93313]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 19 04:10:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.num_shell_tries = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.nvmet_ns_id = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.nvmet_port_id = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.replication_device = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.report_discard_supported = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.reserved_percentage = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.scst_target_driver = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.storage_protocol = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.target_helper = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.target_ip_address = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.target_port = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.target_prefix = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.target_protocol = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.trace_flags = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.unique_fqdn_network = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.use_chap_auth = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.volume_clear = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.volume_clear_ionice = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.volume_clear_size = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] QuobyteHD.volumes_dir = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.ssl = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.ssl_version = {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_notifications.driver = [] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_notifications.retry = -1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] oslo_messaging_notifications.transport_url = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] key_manager.fixed_key = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.barbican_api_version = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.barbican_endpoint = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.barbican_endpoint_type = public {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.barbican_region_name = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.cafile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.certfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.collect_timing = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.insecure = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.keyfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.number_of_retries = 60 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.retry_delay = 1 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.send_service_user_token = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.split_loggers = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.timeout = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.verify_ssl = True {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican.verify_ssl_path = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican_service_user.auth_section = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican_service_user.auth_type = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican_service_user.cafile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican_service_user.certfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican_service_user.collect_timing = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican_service_user.insecure = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican_service_user.keyfile = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican_service_user.split_loggers = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] barbican_service_user.timeout = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] vault.approle_role_id = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] vault.approle_secret_id = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] vault.kv_mountpoint = secret {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] vault.kv_path = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] vault.kv_version = 2 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] vault.namespace = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] vault.root_token_id = **** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] vault.ssl_ca_crt_file = None {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] vault.timeout = 60.0 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] vault.use_ssl = False {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:10:56 devstack cinder-volume[93034]: DEBUG oslo_service.backend._eventlet.service [None req-69440063-7ec6-4b54-b8de-a00a9bf8275d None None] ******************************************************************************** {{(pid=93034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 19 04:10:56 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:10:56 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:57 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.654s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:57 devstack cinder-volume[93300]: INFO cinder.volume.driver [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Driver hasn't implemented _init_vendor_properties() Jun 19 04:10:57 devstack cinder-volume[93300]: DEBUG cinder.volume.driver [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578201293945, 'free_capacity_gb': 1775.7578201293945, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93300) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 19 04:10:57 devstack cinder-volume[93300]: DEBUG oslo_db.sqlalchemy.engines [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93300) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:10:57 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writer thread running {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:10:57 devstack cinder-volume[93300]: DEBUG cinder.db.api [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Building query based on filter {{(pid=93300) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 19 04:10:57 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93300) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 19 04:10:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:10:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:10:57 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:10:57 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:10:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:10:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:57 devstack cinder-volume[93300]: INFO cinder.keymgr.migration [None req-6339977b-56e3-4ee6-bd85-5f79f42e69d4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 19 04:10:57 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:10:57 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:58 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.669s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:58 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:10:58 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Driver initialization completed successfully. Jun 19 04:10:58 devstack cinder-volume[93300]: INFO cinder.manager [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Initiating service 3 cleanup Jun 19 04:10:58 devstack cinder-volume[93300]: INFO cinder.manager [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Service 3 cleanup completed. Jun 19 04:10:58 devstack cinder-volume[93300]: DEBUG cinder.service [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Creating RPC server for service cinder-volume {{(pid=93300) start /opt/stack/cinder/cinder/service.py:231}} Jun 19 04:10:58 devstack cinder-volume[93300]: DEBUG cinder.service [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93300) start /opt/stack/cinder/cinder/service.py:237}} Jun 19 04:10:58 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 19 04:10:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:10:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:10:58 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:10:58 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:10:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:10:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:58 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:10:58 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:59 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.629s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:59 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2ef2003a-dc7a-4fa4-8630-79b6d7cb54bd None None] Driver post RPC initialization completed successfully. Jun 19 04:11:06 devstack cinder-volume[93034]: DEBUG dbcounter [-] [93034] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:11:08 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=2 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:11:09 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:11:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:11:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 6 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:11:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:12:17 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:12:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Flow 'volume_create_manager' (b8a31d05-5127-4b22-a9a0-81dd567f686a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:12:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a84dfe-9eec-454f-b001-b1914de56ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a84dfe-9eec-454f-b001-b1914de56ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1099666111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3167347-0ea6-4509-ae82-eae4c23da788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0fa79e0791470c92c40178192673d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:12:17Z,use_quota=True,user_id='317654cdb12a47859be107441dc8b714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf167340-8f48-4cac-ad44-c5a7c76f034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf167340-8f48-4cac-ad44-c5a7c76f034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f25c66d-cc16-44eb-81bd-c3a7c782d796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f25c66d-cc16-44eb-81bd-c3a7c782d796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3167347-0ea6-4509-ae82-eae4c23da788', 'volume_name': 'volume-f3167347-0ea6-4509-ae82-eae4c23da788', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac8fcf9-d7a5-41c6-8c21-3a57834199a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac8fcf9-d7a5-41c6-8c21-3a57834199a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08fa559-59e4-48f4-ad2c-06c7fa421656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:18 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Volume f3167347-0ea6-4509-ae82-eae4c23da788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3167347-0ea6-4509-ae82-eae4c23da788', 'volume_size': 1} Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1099666111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3167347-0ea6-4509-ae82-eae4c23da788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0fa79e0791470c92c40178192673d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:12:17Z,use_quota=True,user_id='317654cdb12a47859be107441dc8b714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Creating volume f3167347-0ea6-4509-ae82-eae4c23da788 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:12:18 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:12:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:18 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788 1073741824 Jun 19 04:12:18 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:12:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:12:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:12:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:19 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:12:19 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:20 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:20 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.023s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788 1073741824" returned: 0 in 2.145s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:12:20 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:12:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 6 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:12:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:12:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:20 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788 Jun 19 04:12:20 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:21 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788" returned: 0 in 1.265s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] <== create_volume: return (3573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:12:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.581s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08fa559-59e4-48f4-ad2c-06c7fa421656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3167347-0ea6-4509-ae82-eae4c23da788', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f86e7bb-7a8c-4645-9682-7d6f794f6c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:21 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Volume volume-f3167347-0ea6-4509-ae82-eae4c23da788 (f3167347-0ea6-4509-ae82-eae4c23da788): created successfully Jun 19 04:12:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f86e7bb-7a8c-4645-9682-7d6f794f6c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Flow 'volume_create_manager' (b8a31d05-5127-4b22-a9a0-81dd567f686a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:12:21 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-44485b2d-aef5-487e-ba0c-72040bf4416d tempest-DeleteServersTestJSON-617105149 None] Created volume successfully. Jun 19 04:12:31 devstack cinder-volume[93300]: WARNING py.warnings [req-6d3f17d7-daa5-405e-beea-b70ade09e3a2 req-aeeab105-59d4-403c-b8f5-6adaf926ac41 tempest-DeleteServersTestJSON-617105149 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 19 04:12:31 devstack cinder-volume[93300]: .first() Jun 19 04:12:31 devstack cinder-volume[93300]: Jun 19 04:12:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-6d3f17d7-daa5-405e-beea-b70ade09e3a2 req-aeeab105-59d4-403c-b8f5-6adaf926ac41 tempest-DeleteServersTestJSON-617105149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-6d3f17d7-daa5-405e-beea-b70ade09e3a2 req-aeeab105-59d4-403c-b8f5-6adaf926ac41 tempest-DeleteServersTestJSON-617105149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:31 devstack cinder-volume[93300]: INFO oslo.privsep.daemon [req-6d3f17d7-daa5-405e-beea-b70ade09e3a2 req-aeeab105-59d4-403c-b8f5-6adaf926ac41 tempest-DeleteServersTestJSON-617105149 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdp4w02h_/privsep.sock'] Jun 19 04:12:31 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdp4w02h_/privsep.sock Jun 19 04:12:31 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:33 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 19 04:12:33 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:12:33 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 19 04:12:33 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 04:12:33 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:12:33 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 19 04:12:33 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:12:33 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 04:12:33 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 19 04:12:34 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 19 04:12:34 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:12:34 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 19 04:12:34 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 04:12:34 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:12:34 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 19 04:12:34 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:12:34 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 04:12:34 devstack cinder-volume[93300]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 19 04:12:35 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:35 devstack cinder-volume[93300]: INFO oslo.privsep.daemon [req-6d3f17d7-daa5-405e-beea-b70ade09e3a2 req-aeeab105-59d4-403c-b8f5-6adaf926ac41 tempest-DeleteServersTestJSON-617105149 None] Spawned new privsep daemon via rootwrap Jun 19 04:12:35 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [req-6d3f17d7-daa5-405e-beea-b70ade09e3a2 req-aeeab105-59d4-403c-b8f5-6adaf926ac41 tempest-DeleteServersTestJSON-617105149 None] Accepted privsep connection to /tmp/tmpdp4w02h_/privsep.sock {{(pid=93300) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 19 04:12:35 devstack cinder-volume[93300]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 19 04:12:35 devstack cinder-volume[93300]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 19 04:12:35 devstack cinder-volume[93300]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 19 04:12:35 devstack cinder-volume[93300]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94600 Jun 19 04:12:35 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[27aa9ffa-d740-4e1b-830e-3d52f1998f35]: (2,) {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:12:35 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[848df9f4-6e98-49b0-8451-ae62a384fec7]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:12:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-6d3f17d7-daa5-405e-beea-b70ade09e3a2 req-aeeab105-59d4-403c-b8f5-6adaf926ac41 tempest-DeleteServersTestJSON-617105149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:35 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788 Jun 19 04:12:35 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:36 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-6d3f17d7-daa5-405e-beea-b70ade09e3a2 req-aeeab105-59d4-403c-b8f5-6adaf926ac41 tempest-DeleteServersTestJSON-617105149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788" returned: 0 in 1.087s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-6d3f17d7-daa5-405e-beea-b70ade09e3a2 req-aeeab105-59d4-403c-b8f5-6adaf926ac41 tempest-DeleteServersTestJSON-617105149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 5.101s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-6d3f17d7-daa5-405e-beea-b70ade09e3a2 req-aeeab105-59d4-403c-b8f5-6adaf926ac41 tempest-DeleteServersTestJSON-617105149 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-f3167347-0ea6-4509-ae82-eae4c23da788', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf5f1adb-249b-4152-88db-b2e7e79cba54', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:12:36 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-6d3f17d7-daa5-405e-beea-b70ade09e3a2 req-aeeab105-59d4-403c-b8f5-6adaf926ac41 tempest-DeleteServersTestJSON-617105149 None] attachment_update completed successfully. Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Flow 'volume_create_manager' (97fdd43e-fe86-4af9-af23-e67f7ae9c5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c55b15-724b-4c29-a399-2875e3e11cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c55b15-724b-4c29-a399-2875e3e11cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2062843192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c01b1e-45c1-4efb-9d2f-8ce88e67426e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67034445cf2c4d96b74d866024d10c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:12:40Z,use_quota=True,user_id='3656703ce08f406dabc12cf0892e8b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97ed756-c262-4e86-baae-c73ffc9b01ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97ed756-c262-4e86-baae-c73ffc9b01ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8061ac5f-cbbf-4198-8008-9a3f4787871d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8061ac5f-cbbf-4198-8008-9a3f4787871d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c01b1e-45c1-4efb-9d2f-8ce88e67426e', 'volume_name': 'volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48902f97-59d6-41de-8027-52b8fdbb0bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48902f97-59d6-41de-8027-52b8fdbb0bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363ac486-bd15-403a-b4cc-497d3c3a025a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:39 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Volume a7c01b1e-45c1-4efb-9d2f-8ce88e67426e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e', 'volume_size': 1} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2062843192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c01b1e-45c1-4efb-9d2f-8ce88e67426e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67034445cf2c4d96b74d866024d10c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:12:40Z,use_quota=True,user_id='3656703ce08f406dabc12cf0892e8b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Creating volume a7c01b1e-45c1-4efb-9d2f-8ce88e67426e {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:12:39 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:12:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:39 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e 1073741824 Jun 19 04:12:39 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:40 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e 1073741824" returned: 0 in 1.140s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:41 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e Jun 19 04:12:41 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:42 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e" returned: 0 in 1.015s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] <== create_volume: return (2248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:12:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.250s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363ac486-bd15-403a-b4cc-497d3c3a025a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a68a8d-d400-4710-80f3-69145a4c9c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:42 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Volume volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e (a7c01b1e-45c1-4efb-9d2f-8ce88e67426e): created successfully Jun 19 04:12:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a68a8d-d400-4710-80f3-69145a4c9c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Flow 'volume_create_manager' (97fdd43e-fe86-4af9-af23-e67f7ae9c5d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:12:42 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-0cb53aab-9cbd-42d6-8e96-2a014f750199 tempest-VolumesAdminNegativeTest-907380864 None] Created volume successfully. Jun 19 04:12:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Acquiring lock "cinder-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:12:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Lock "cinder-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:12:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Acquiring lock "cinder-quobyte-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:12:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Lock "cinder-quobyte-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e" acquired by "delete_volume" :: waited 0.040s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:12:45 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1223e4e-f618-4bfa-a0bd-b11fd6802b00]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:12:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:46 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e Jun 19 04:12:46 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:47 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e" returned: 0 in 1.545s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:47 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e Jun 19 04:12:47 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:48 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e" returned: 0 in 1.262s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Lock "cinder-quobyte-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e" released by "delete_volume" :: held 2.906s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:12:48 devstack cinder-volume[93300]: WARNING cinder.quota [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:12:48 devstack cinder-volume[93300]: WARNING cinder.quota [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:12:48 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Created reservations ['b3fdcb66-7c38-476a-8443-6a9c691e7798', 'de4489e1-934f-4ee2-9eea-d234e22382ae', '93ae9726-93fa-4cf7-a855-762e4e389a3a', '39cf39e1-70a8-401a-a4dc-29635c4d43b9'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:12:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:12:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:12:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:48 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:12:48 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:49 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-a40d9a16-f95b-4855-acbe-e17d2837c3fa req-a94513b9-3a2b-45f2-8444-293019ff9d7b tempest-DeleteServersTestJSON-617105149 None] Terminate volume connection completed successfully. Jun 19 04:12:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-a40d9a16-f95b-4855-acbe-e17d2837c3fa req-a94513b9-3a2b-45f2-8444-293019ff9d7b tempest-DeleteServersTestJSON-617105149 None] Deleting attachment bf5f1adb-249b-4152-88db-b2e7e79cba54. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:12:49 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.171s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:49 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:12:49 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Deleted volume successfully. Jun 19 04:12:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26b03b41-0055-47c9-a05d-97f6bd2d30fa tempest-VolumesAdminNegativeTest-907380864 None] Lock "cinder-a7c01b1e-45c1-4efb-9d2f-8ce88e67426e-delete_volume" released by "delete_volume" :: held 4.444s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:12:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Acquiring lock "cinder-f3167347-0ea6-4509-ae82-eae4c23da788-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:12:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Lock "cinder-f3167347-0ea6-4509-ae82-eae4c23da788-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:12:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Acquiring lock "cinder-quobyte-f3167347-0ea6-4509-ae82-eae4c23da788" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:12:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Lock "cinder-quobyte-f3167347-0ea6-4509-ae82-eae4c23da788" acquired by "delete_volume" :: waited 0.029s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:12:53 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[534bd831-3c51-475c-9aa5-0dce1414a3b5]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:12:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:53 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788 Jun 19 04:12:53 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:54 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788" returned: 0 in 1.156s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:54 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788 Jun 19 04:12:54 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:55 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f3167347-0ea6-4509-ae82-eae4c23da788" returned: 0 in 0.754s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Lock "cinder-quobyte-f3167347-0ea6-4509-ae82-eae4c23da788" released by "delete_volume" :: held 1.962s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:12:55 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Created reservations ['112494fc-bfe7-4946-b31a-ff2c3a442fd3', 'aa737a72-3d9f-407b-b7f3-4bd18219e566', 'ee7c758d-fe1e-435e-b69b-c0e0626317f0', '3f211f32-ca01-4544-a5c8-7d9e2fd49451'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:12:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:12:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:12:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:55 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:12:55 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:56 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.781s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:56 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:12:56 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Deleted volume successfully. Jun 19 04:12:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3976f153-06c3-4579-9cfe-f94823f36ec0 tempest-DeleteServersTestJSON-617105149 None] Lock "cinder-f3167347-0ea6-4509-ae82-eae4c23da788-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Flow 'volume_create_manager' (01abeb02-e546-4107-a5b7-36894f1959e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37001e38-3b7c-4e8e-8580-1b94c81ea50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37001e38-3b7c-4e8e-8580-1b94c81ea50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1778273185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69a394f-310a-4c50-872c-5fe29cbc71fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f9ea01fd54349d699bccaaa4a7f1d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:02Z,use_quota=True,user_id='fd042cdd4761406b8d4f54cb9975945e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4875d847-f3db-456a-8eb5-55e36002cceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4875d847-f3db-456a-8eb5-55e36002cceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c886320-0209-4bb3-870b-3b58422fd236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c886320-0209-4bb3-870b-3b58422fd236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a69a394f-310a-4c50-872c-5fe29cbc71fc', 'volume_name': 'volume-a69a394f-310a-4c50-872c-5fe29cbc71fc', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe4eccd-1fe6-4cec-bd03-72b7d34c877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe4eccd-1fe6-4cec-bd03-72b7d34c877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7917b4e-5d8c-4dd1-b0a1-bfd20a9e000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:01 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Volume a69a394f-310a-4c50-872c-5fe29cbc71fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a69a394f-310a-4c50-872c-5fe29cbc71fc', 'volume_size': 1} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1778273185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69a394f-310a-4c50-872c-5fe29cbc71fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f9ea01fd54349d699bccaaa4a7f1d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:02Z,use_quota=True,user_id='fd042cdd4761406b8d4f54cb9975945e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Creating volume a69a394f-310a-4c50-872c-5fe29cbc71fc {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:13:01 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:13:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a69a394f-310a-4c50-872c-5fe29cbc71fc 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:01 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a69a394f-310a-4c50-872c-5fe29cbc71fc 1073741824 Jun 19 04:13:01 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:02 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a69a394f-310a-4c50-872c-5fe29cbc71fc 1073741824" returned: 0 in 1.101s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a69a394f-310a-4c50-872c-5fe29cbc71fc {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:02 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a69a394f-310a-4c50-872c-5fe29cbc71fc Jun 19 04:13:02 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:03 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a69a394f-310a-4c50-872c-5fe29cbc71fc" returned: 0 in 0.843s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:13:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7917b4e-5d8c-4dd1-b0a1-bfd20a9e000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a69a394f-310a-4c50-872c-5fe29cbc71fc', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3bfc76-9707-4cd7-a437-735bd279faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:03 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Volume volume-a69a394f-310a-4c50-872c-5fe29cbc71fc (a69a394f-310a-4c50-872c-5fe29cbc71fc): created successfully Jun 19 04:13:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3bfc76-9707-4cd7-a437-735bd279faad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Flow 'volume_create_manager' (01abeb02-e546-4107-a5b7-36894f1959e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:03 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-abccf1f1-dcca-4d68-852a-f41077f9b09d tempest-ServersNegativeTestJSON-223664484 None] Created volume successfully. Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Flow 'volume_create_manager' (dc2f4c4b-ad37-44b6-b226-dda11afee970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5524df-a0c3-429c-a117-5845a8301957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5524df-a0c3-429c-a117-5845a8301957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2129728652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8362c3dd-7502-4ae1-b727-b7c9e036af62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462f1538a4174c7b82599598a82450ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:05Z,use_quota=True,user_id='6a7b7ea3fc174a9aa0dda908fade4e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f6211d-8436-4db4-8d60-9bd047056b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f6211d-8436-4db4-8d60-9bd047056b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb083697-a202-444b-8acf-603da847cce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb083697-a202-444b-8acf-603da847cce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8362c3dd-7502-4ae1-b727-b7c9e036af62', 'volume_name': 'volume-8362c3dd-7502-4ae1-b727-b7c9e036af62', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90222191-35be-4a05-98b6-aa411b21adcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90222191-35be-4a05-98b6-aa411b21adcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066916b7-ffdf-45e9-a234-f5fb4b9af8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:04 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Volume 8362c3dd-7502-4ae1-b727-b7c9e036af62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8362c3dd-7502-4ae1-b727-b7c9e036af62', 'volume_size': 1} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2129728652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8362c3dd-7502-4ae1-b727-b7c9e036af62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462f1538a4174c7b82599598a82450ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:05Z,use_quota=True,user_id='6a7b7ea3fc174a9aa0dda908fade4e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Creating volume 8362c3dd-7502-4ae1-b727-b7c9e036af62 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:13:04 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:13:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:04 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62 1073741824 Jun 19 04:13:04 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:05 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62 1073741824" returned: 0 in 1.294s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:06 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62 Jun 19 04:13:06 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:06 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62" returned: 0 in 0.910s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] <== create_volume: return (2284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:13:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066916b7-ffdf-45e9-a234-f5fb4b9af8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8362c3dd-7502-4ae1-b727-b7c9e036af62', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa4e304-8463-4113-b45f-580c45d06ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:07 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Volume volume-8362c3dd-7502-4ae1-b727-b7c9e036af62 (8362c3dd-7502-4ae1-b727-b7c9e036af62): created successfully Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa4e304-8463-4113-b45f-580c45d06ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Flow 'volume_create_manager' (dc2f4c4b-ad37-44b6-b226-dda11afee970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:07 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-dd0eeb84-f0cc-4620-a756-d1add6869fd0 tempest-TaggedAttachmentsTest-1952420932 None] Created volume successfully. Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Flow 'volume_create_manager' (8e21ac4d-345b-463a-a7b3-c497cf74949a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9446eb-83f2-465d-9bf4-42b6372c5082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9446eb-83f2-465d-9bf4-42b6372c5082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-114390077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f768b83a-8ce0-4697-93c6-f85895c086ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f9ea01fd54349d699bccaaa4a7f1d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:07Z,use_quota=True,user_id='fd042cdd4761406b8d4f54cb9975945e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efaea025-4bb2-44f6-843e-fcac51e02b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efaea025-4bb2-44f6-843e-fcac51e02b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd6968d-9fc1-46d4-b17d-1853a41dfff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd6968d-9fc1-46d4-b17d-1853a41dfff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f768b83a-8ce0-4697-93c6-f85895c086ba', 'volume_name': 'volume-f768b83a-8ce0-4697-93c6-f85895c086ba', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8855b9e-1a60-4db6-ae24-72105949f570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8855b9e-1a60-4db6-ae24-72105949f570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6ca0cf-260a-4164-8ec1-b684bc47bb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:07 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Volume f768b83a-8ce0-4697-93c6-f85895c086ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f768b83a-8ce0-4697-93c6-f85895c086ba', 'volume_size': 1} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-114390077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f768b83a-8ce0-4697-93c6-f85895c086ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f9ea01fd54349d699bccaaa4a7f1d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:07Z,use_quota=True,user_id='fd042cdd4761406b8d4f54cb9975945e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Creating volume f768b83a-8ce0-4697-93c6-f85895c086ba {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:13:07 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:13:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f768b83a-8ce0-4697-93c6-f85895c086ba 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:07 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f768b83a-8ce0-4697-93c6-f85895c086ba 1073741824 Jun 19 04:13:07 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:08 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f768b83a-8ce0-4697-93c6-f85895c086ba 1073741824" returned: 0 in 1.165s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f768b83a-8ce0-4697-93c6-f85895c086ba {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:08 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f768b83a-8ce0-4697-93c6-f85895c086ba Jun 19 04:13:08 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:09 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f768b83a-8ce0-4697-93c6-f85895c086ba" returned: 0 in 0.738s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:13:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:09 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=26,cinder:UPDATE=33,cinder:INSERT=5,cinder:DELETE=4 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:13:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6ca0cf-260a-4164-8ec1-b684bc47bb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f768b83a-8ce0-4697-93c6-f85895c086ba', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3892b8d8-6ff6-4890-abc9-d1b596cbf99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:09 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=28,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=8 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:13:09 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Volume volume-f768b83a-8ce0-4697-93c6-f85895c086ba (f768b83a-8ce0-4697-93c6-f85895c086ba): created successfully Jun 19 04:13:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3892b8d8-6ff6-4890-abc9-d1b596cbf99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Flow 'volume_create_manager' (8e21ac4d-345b-463a-a7b3-c497cf74949a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:09 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-15cc7fc9-364d-485f-8adb-3b7f9fa4b084 tempest-ServersNegativeTestJSON-223664484 None] Created volume successfully. Jun 19 04:13:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Acquiring lock "cinder-f768b83a-8ce0-4697-93c6-f85895c086ba-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Lock "cinder-f768b83a-8ce0-4697-93c6-f85895c086ba-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Acquiring lock "cinder-quobyte-f768b83a-8ce0-4697-93c6-f85895c086ba" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Lock "cinder-quobyte-f768b83a-8ce0-4697-93c6-f85895c086ba" acquired by "delete_volume" :: waited 0.036s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:15 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[18488d14-6058-4ad4-b503-f6f73b91341f]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:13:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f768b83a-8ce0-4697-93c6-f85895c086ba {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:15 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f768b83a-8ce0-4697-93c6-f85895c086ba Jun 19 04:13:15 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f768b83a-8ce0-4697-93c6-f85895c086ba" returned: 0 in 1.043s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f768b83a-8ce0-4697-93c6-f85895c086ba {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:16 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:16 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f768b83a-8ce0-4697-93c6-f85895c086ba Jun 19 04:13:16 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:17 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f768b83a-8ce0-4697-93c6-f85895c086ba" returned: 0 in 0.759s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Lock "cinder-quobyte-f768b83a-8ce0-4697-93c6-f85895c086ba" released by "delete_volume" :: held 1.861s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:13:17 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Created reservations ['018d26e0-d8f5-4c6e-9f2c-15c3166a82cd', 'f8fe5c22-7349-4d34-86c7-4b6d35f02b96', '6264b472-c164-43b1-8cb2-20ebb732bc99', 'bb16d959-8ac0-46ca-a644-d017fc241303'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:13:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:17 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:13:17 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Acquiring lock "cinder-a69a394f-310a-4c50-872c-5fe29cbc71fc-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Lock "cinder-a69a394f-310a-4c50-872c-5fe29cbc71fc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Acquiring lock "cinder-quobyte-a69a394f-310a-4c50-872c-5fe29cbc71fc" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Lock "cinder-quobyte-a69a394f-310a-4c50-872c-5fe29cbc71fc" acquired by "delete_volume" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:18 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[67088cda-075f-46ec-b803-7d15a27a8c99]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:13:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a69a394f-310a-4c50-872c-5fe29cbc71fc {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:18 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a69a394f-310a-4c50-872c-5fe29cbc71fc Jun 19 04:13:18 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:18 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.107s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:18 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:13:18 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Deleted volume successfully. Jun 19 04:13:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7637fae8-02c5-4de8-8f3b-8fa600a2f7ae tempest-ServersNegativeTestJSON-223664484 None] Lock "cinder-f768b83a-8ce0-4697-93c6-f85895c086ba-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:13:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:13:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:19 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a69a394f-310a-4c50-872c-5fe29cbc71fc" returned: 0 in 0.922s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a69a394f-310a-4c50-872c-5fe29cbc71fc {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:19 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:13:19 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:19 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a69a394f-310a-4c50-872c-5fe29cbc71fc Jun 19 04:13:19 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:20 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.957s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:13:20 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a69a394f-310a-4c50-872c-5fe29cbc71fc" returned: 0 in 0.995s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Lock "cinder-quobyte-a69a394f-310a-4c50-872c-5fe29cbc71fc" released by "delete_volume" :: held 2.021s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:13:20 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Created reservations ['8cb2c2c1-c02f-4b22-b8af-34f6b03f5001', '05abbf43-6b60-482d-8a11-12d75bf8e191', 'e11f328d-bc18-4ea3-b48d-b5af0f875ec1', '2e7de56e-fa52-42e8-8c11-8f445b6b94d6'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:13:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:20 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:20 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:20 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:13:20 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:21 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.864s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:21 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:13:21 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Deleted volume successfully. Jun 19 04:13:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1487b3d7-0186-4f69-9630-5748385466d4 tempest-ServersNegativeTestJSON-223664484 None] Lock "cinder-a69a394f-310a-4c50-872c-5fe29cbc71fc-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:13:30 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=18 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:13:31 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=15,cinder:DELETE=3,cinder:SELECT=10,cinder:INSERT=3 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:13:44 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d7b4cd5b-6671-4e45-bc30-3a7f83658a57 tempest-GroupSnapshotsTest-721679089 None] Group tempest-GroupSnapshotsTest-Group-1849900238: creating Jun 19 04:13:44 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d7b4cd5b-6671-4e45-bc30-3a7f83658a57 tempest-GroupSnapshotsTest-721679089 None] Group tempest-GroupSnapshotsTest-Group-1849900238: created successfully Jun 19 04:13:44 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d7b4cd5b-6671-4e45-bc30-3a7f83658a57 tempest-GroupSnapshotsTest-721679089 None] Create group completed successfully. Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Flow 'volume_create_manager' (30d761e1-fa7c-4466-abfe-2c63927b6921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571950ab-221c-46cc-81eb-1370ba2a6982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571950ab-221c-46cc-81eb-1370ba2a6982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-984511944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eef4fc69-321c-4aa8-b07f-db8001d2c688,host='devstack@QuobyteHD#QuobyteHD',id=61fa179b-5cf2-445d-b6ea-368f81c7090b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d39bed38ff4768a736a611beb8d231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:47Z,use_quota=True,user_id='7ad474ac50324140a717e7b36e8df2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(168d69b1-c4cf-40f9-a4f0-ff449832cf85),volume_type_id=168d69b1-c4cf-40f9-a4f0-ff449832cf85)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ea41fb-35ba-4759-a467-1c1cd8dfcc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ea41fb-35ba-4759-a467-1c1cd8dfcc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0964b59e-6c72-4e47-b1b6-b984df4c1552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0964b59e-6c72-4e47-b1b6-b984df4c1552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61fa179b-5cf2-445d-b6ea-368f81c7090b', 'volume_name': 'volume-61fa179b-5cf2-445d-b6ea-368f81c7090b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c259a3-5a9f-4b21-8d31-6e2717d5064c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c259a3-5a9f-4b21-8d31-6e2717d5064c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de08459-2227-4ebd-842d-8f52057d6f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:46 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Volume 61fa179b-5cf2-445d-b6ea-368f81c7090b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61fa179b-5cf2-445d-b6ea-368f81c7090b', 'volume_size': 1} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eef4fc69-321c-4aa8-b07f-db8001d2c688,created_at=2026-06-19T02:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-984511944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eef4fc69-321c-4aa8-b07f-db8001d2c688,host='devstack@QuobyteHD#QuobyteHD',id=61fa179b-5cf2-445d-b6ea-368f81c7090b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d39bed38ff4768a736a611beb8d231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:47Z,use_quota=True,user_id='7ad474ac50324140a717e7b36e8df2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(168d69b1-c4cf-40f9-a4f0-ff449832cf85),volume_type_id=168d69b1-c4cf-40f9-a4f0-ff449832cf85)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Creating volume 61fa179b-5cf2-445d-b6ea-368f81c7090b {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:13:46 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:13:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:46 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b 1073741824 Jun 19 04:13:46 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:48 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b 1073741824" returned: 0 in 1.893s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:48 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b Jun 19 04:13:48 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:49 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b" returned: 0 in 0.966s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] <== create_volume: return (2972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:13:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.975s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de08459-2227-4ebd-842d-8f52057d6f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61fa179b-5cf2-445d-b6ea-368f81c7090b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1e1bc7-8774-458c-9e86-30db9c4ba845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:49 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Volume volume-61fa179b-5cf2-445d-b6ea-368f81c7090b (61fa179b-5cf2-445d-b6ea-368f81c7090b): created successfully Jun 19 04:13:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1e1bc7-8774-458c-9e86-30db9c4ba845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Flow 'volume_create_manager' (30d761e1-fa7c-4466-abfe-2c63927b6921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:49 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-60247590-3c49-4d1b-adb5-d0c0c291c56e tempest-GroupSnapshotsTest-721679089 None] Created volume successfully. Jun 19 04:13:51 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] GroupSnapshot 7dfe8efa-131f-41ac-98b7-6e1008c2edca: creating. Jun 19 04:13:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] Group snapshot 7dfe8efa-131f-41ac-98b7-6e1008c2edca: creating. {{(pid=93300) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 19 04:13:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] Creating offline snapshot 2de08520-2726-4748-a74b-abf4bf47a6d7 of volume 61fa179b-5cf2-445d-b6ea-368f81c7090b {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:13:51 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49c9221-97d7-4faf-888f-d01dcc64a8d8]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:13:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:51 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b Jun 19 04:13:51 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:52 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b" returned: 0 in 1.175s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:52 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 1G Jun 19 04:13:52 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:53 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 1G" returned: 0 in 0.994s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61fa179b-5cf2-445d-b6ea-368f81c7090b -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:53 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61fa179b-5cf2-445d-b6ea-368f81c7090b -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 Jun 19 04:13:53 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:54 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61fa179b-5cf2-445d-b6ea-368f81c7090b -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7" returned: 0 in 0.788s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:54 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:13:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:54 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 Jun 19 04:13:54 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:55 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7" returned: 0 in 0.680s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:55 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.info Jun 19 04:13:55 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:55 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.info" returned: 0 in 0.651s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:55 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:13:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:55 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.info Jun 19 04:13:55 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:56 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.info" returned: 0 in 0.767s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.148s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:56 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-6962518a-ad3b-467c-8e39-bd21d7d29318 tempest-GroupSnapshotsTest-721679089 None] group_snapshot 7dfe8efa-131f-41ac-98b7-6e1008c2edca: created successfully Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-2de08520-2726-4748-a74b-abf4bf47a6d7-0e41c96a-0b17-4a56-99b2-add55ca43c0a" by "_create_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-2de08520-2726-4748-a74b-abf4bf47a6d7-0e41c96a-0b17-4a56-99b2-add55ca43c0a" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Creating volume 0e41c96a-0b17-4a56-99b2-add55ca43c0a from snapshot 2de08520-2726-4748-a74b-abf4bf47a6d7 {{(pid=93300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-0e41c96a-0b17-4a56-99b2-add55ca43c0a" by "_copy_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-0e41c96a-0b17-4a56-99b2-add55ca43c0a" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] snapshot: 2de08520-2726-4748-a74b-abf4bf47a6d7, volume: 0e41c96a-0b17-4a56-99b2-add55ca43c0a, {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bb77af-381a-4ef9-9204-459d36d350f4]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:13:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:59 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 Jun 19 04:13:59 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:00 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7" returned: 0 in 0.960s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61fa179b-5cf2-445d-b6ea-368f81c7090b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:14:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:14:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Creating direct copy from snapshot {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:14:00 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7e78cf-7560-4c24-a4de-19496ff4023f]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:00 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b Jun 19 04:14:00 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:01 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b" returned: 0 in 1.177s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:01 devstack cinder-volume[93300]: DEBUG cinder.utils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Path /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a not found in is_blk_device check {{(pid=93300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:14:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:01 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a Jun 19 04:14:01 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:09 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:14:09 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=13,cinder:UPDATE=8 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:14:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a" returned: 0 in 8.565s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:09 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c0243b-48a5-4d10-8c3c-9df9670b259d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:10 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b Jun 19 04:14:10 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:12 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b" returned: 0 in 2.285s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:14:12 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Converted 1024.00 MB image at 119.52 MB/s Jun 19 04:14:12 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:12 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a Jun 19 04:14:12 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Flow 'volume_create_manager' (3e9e3789-526d-4f0e-946e-637956d260bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb0275b-51e8-4fbc-ad34-5fbd6b2b520f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb0275b-51e8-4fbc-ad34-5fbd6b2b520f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1084653905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f053c724-7de7-44bf-894e-ccda629d5180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558f44fbcf3f4e409065b491f3562e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:13Z,use_quota=True,user_id='569bbc4c34034f8eab1230275121e36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b075a426-847a-4380-9297-e5aac09ef137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b075a426-847a-4380-9297-e5aac09ef137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6975fc5a-393b-4692-83fa-8eb1f14eee1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6975fc5a-393b-4692-83fa-8eb1f14eee1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f053c724-7de7-44bf-894e-ccda629d5180', 'volume_name': 'volume-f053c724-7de7-44bf-894e-ccda629d5180', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9196d8f-c97c-4813-a6ee-c2f2f0d902b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9196d8f-c97c-4813-a6ee-c2f2f0d902b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df6d67b-7ecc-4e10-8f14-ef0bbe159f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:12 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Volume f053c724-7de7-44bf-894e-ccda629d5180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f053c724-7de7-44bf-894e-ccda629d5180', 'volume_size': 1} Jun 19 04:14:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:13 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a" returned: 0 in 0.985s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-0e41c96a-0b17-4a56-99b2-add55ca43c0a" released by "_copy_volume_from_snapshot" :: held 14.143s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-2de08520-2726-4748-a74b-abf4bf47a6d7-0e41c96a-0b17-4a56-99b2-add55ca43c0a" released by "_create_volume_from_snapshot" :: held 14.174s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.189s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.454s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1084653905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f053c724-7de7-44bf-894e-ccda629d5180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558f44fbcf3f4e409065b491f3562e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:13Z,use_quota=True,user_id='569bbc4c34034f8eab1230275121e36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Creating volume f053c724-7de7-44bf-894e-ccda629d5180 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:14:13 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:14:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f053c724-7de7-44bf-894e-ccda629d5180 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:13 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f053c724-7de7-44bf-894e-ccda629d5180 1073741824 Jun 19 04:14:13 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:13 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ccd7e88f-b45c-4d62-bdff-d9c0dc052ea3 tempest-GroupSnapshotsTest-721679089 None] Create group from source-snapshot-7dfe8efa-131f-41ac-98b7-6e1008c2edca completed successfully. Jun 19 04:14:14 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f053c724-7de7-44bf-894e-ccda629d5180 1073741824" returned: 0 in 0.898s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f053c724-7de7-44bf-894e-ccda629d5180 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:14 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f053c724-7de7-44bf-894e-ccda629d5180 Jun 19 04:14:14 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-0e41c96a-0b17-4a56-99b2-add55ca43c0a" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:14:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-0e41c96a-0b17-4a56-99b2-add55ca43c0a" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:14:14 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f850c55b-57e8-4d15-827e-575080045f89]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:15 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f053c724-7de7-44bf-894e-ccda629d5180" returned: 0 in 0.778s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:14:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df6d67b-7ecc-4e10-8f14-ef0bbe159f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f053c724-7de7-44bf-894e-ccda629d5180', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8d8b96-101b-4bb4-ae98-86e286ad91f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:15 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Volume volume-f053c724-7de7-44bf-894e-ccda629d5180 (f053c724-7de7-44bf-894e-ccda629d5180): created successfully Jun 19 04:14:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8d8b96-101b-4bb4-ae98-86e286ad91f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Flow 'volume_create_manager' (3e9e3789-526d-4f0e-946e-637956d260bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:15 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-97618dc6-3b2d-42ec-9350-544d5a5fe69a tempest-AttachVolumeShelveTestJSON-1318300943 None] Created volume successfully. Jun 19 04:14:15 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a Jun 19 04:14:15 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:15 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a" returned: 0 in 0.802s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:15 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a Jun 19 04:14:15 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:16 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0e41c96a-0b17-4a56-99b2-add55ca43c0a" returned: 0 in 0.627s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-0e41c96a-0b17-4a56-99b2-add55ca43c0a" released by "delete_volume" :: held 1.489s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:14:16 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Created reservations ['865737af-f84f-45af-8b28-95c92abd5651'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:14:16 devstack cinder-volume[93300]: WARNING cinder.quota [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-832080855 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-832080855, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:14:16 devstack cinder-volume[93300]: WARNING cinder.quota [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-832080855 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-832080855, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:14:16 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Created reservations ['23a73731-ed29-416d-a976-a3cf3b731153', '004af424-950c-401c-81c4-3ac7c74fd934', '02eb33b1-cff2-41a8-b99b-32caed6a7ece', 'd91f7d7a-5373-477b-b91a-a04ffd17174d'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:14:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:16 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:14:16 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:17 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.721s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:14:17 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e0a7bfb6-afbb-4cd0-9166-da3f65c7b8dc tempest-GroupSnapshotsTest-721679089 None] Delete group completed successfully. Jun 19 04:14:17 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] group_snapshot 7dfe8efa-131f-41ac-98b7-6e1008c2edca: deleting Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] group_snapshot 7dfe8efa-131f-41ac-98b7-6e1008c2edca: deleting {{(pid=93300) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-61fa179b-5cf2-445d-b6ea-368f81c7090b" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-61fa179b-5cf2-445d-b6ea-368f81c7090b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-2de08520-2726-4748-a74b-abf4bf47a6d7" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-2de08520-2726-4748-a74b-abf4bf47a6d7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Deleting offline snapshot 2de08520-2726-4748-a74b-abf4bf47a6d7 of volume 61fa179b-5cf2-445d-b6ea-368f81c7090b {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] snapshot_file for this snap is: volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfde1f4-77c8-4e0e-a7da-0563ca7b2760]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-d53d8301-ab36-41b3-9b13-3bbb9a1e7042 req-2b47ac93-2bbe-4f31-8019-6782fe398f74 tempest-TaggedAttachmentsTest-1952420932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-d53d8301-ab36-41b3-9b13-3bbb9a1e7042 req-2b47ac93-2bbe-4f31-8019-6782fe398f74 tempest-TaggedAttachmentsTest-1952420932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8f4156-8215-47ac-8007-f27aca3978e1]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-d53d8301-ab36-41b3-9b13-3bbb9a1e7042 req-2b47ac93-2bbe-4f31-8019-6782fe398f74 tempest-TaggedAttachmentsTest-1952420932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:17 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 Jun 19 04:14:17 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:17 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62 Jun 19 04:14:17 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:18 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7" returned: 0 in 0.777s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61fa179b-5cf2-445d-b6ea-368f81c7090b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:14:18 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-d53d8301-ab36-41b3-9b13-3bbb9a1e7042 req-2b47ac93-2bbe-4f31-8019-6782fe398f74 tempest-TaggedAttachmentsTest-1952420932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62" returned: 0 in 0.760s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-d53d8301-ab36-41b3-9b13-3bbb9a1e7042 req-2b47ac93-2bbe-4f31-8019-6782fe398f74 tempest-TaggedAttachmentsTest-1952420932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.784s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:18 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b071dab-ac8b-49b8-8791-a9a6e1f48795]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-d53d8301-ab36-41b3-9b13-3bbb9a1e7042 req-2b47ac93-2bbe-4f31-8019-6782fe398f74 tempest-TaggedAttachmentsTest-1952420932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-8362c3dd-7502-4ae1-b727-b7c9e036af62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e85a27a-95a0-495d-b2bd-dd493e57372f', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:14:18 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b Jun 19 04:14:18 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:18 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-d53d8301-ab36-41b3-9b13-3bbb9a1e7042 req-2b47ac93-2bbe-4f31-8019-6782fe398f74 tempest-TaggedAttachmentsTest-1952420932 None] attachment_update completed successfully. Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:19 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:14:19 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:19 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b" returned: 0 in 1.002s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:19 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 Jun 19 04:14:19 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:19 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.750s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 8 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:14:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:14:20 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7" returned: 0 in 0.869s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:20 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7 Jun 19 04:14:20 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:20 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b.2de08520-2726-4748-a74b-abf4bf47a6d7" returned: 0 in 0.681s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-2de08520-2726-4748-a74b-abf4bf47a6d7" released by "_delete_snapshot" :: held 3.464s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:14:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-61fa179b-5cf2-445d-b6ea-368f81c7090b" released by "delete_snapshot" :: held 3.485s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:14:21 devstack cinder-volume[93300]: WARNING cinder.quota [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-832080855 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-832080855, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:14:21 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] Created reservations ['952796fa-47f3-4ad8-a970-328cc8df786f', 'e871da99-dd67-41aa-939d-b14e3720a177', '28e226cd-3b09-4c5d-b47c-e41b987db23b', 'c9d47ec3-3d5b-4189-a866-b53a0b87f13d'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:14:21 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-318efe7d-3586-496b-aa6e-81c850153143 tempest-GroupSnapshotsTest-721679089 None] group_snapshot 7dfe8efa-131f-41ac-98b7-6e1008c2edca: deleted successfully Jun 19 04:14:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-61fa179b-5cf2-445d-b6ea-368f81c7090b" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:14:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-61fa179b-5cf2-445d-b6ea-368f81c7090b" acquired by "delete_volume" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:14:22 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f6497f-1d94-4240-82da-dd0a66e639fc]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:22 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b Jun 19 04:14:22 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:23 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b" returned: 0 in 0.908s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:23 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b Jun 19 04:14:23 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:24 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61fa179b-5cf2-445d-b6ea-368f81c7090b" returned: 0 in 0.767s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-61fa179b-5cf2-445d-b6ea-368f81c7090b" released by "delete_volume" :: held 1.775s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:14:24 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Created reservations ['4dfeac14-2b48-4281-bc74-716c39c8e596'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:14:24 devstack cinder-volume[93300]: WARNING cinder.db.api [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-832080855'] Jun 19 04:14:24 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Created reservations ['292fb3ba-bb10-412a-b7d5-329c5916d763', '7c863ec7-9abb-4cfe-acb5-aae4171f754e', '03557b66-0f4e-479b-b49e-db07767ffd51', '5a15f20c-556d-403f-98a4-288d9c011d8b'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:14:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:24 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:24 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:24 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:14:24 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:25 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.735s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:25 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:14:25 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-42ef7aa6-bd75-444d-9dbe-c5b59d70f927 tempest-GroupSnapshotsTest-721679089 None] Delete group completed successfully. Jun 19 04:14:25 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e2942169-039c-4f21-8c59-56570b6c90ab tempest-GroupSnapshotsTest-721679089 None] Group tempest-GroupSnapshotsTest-Group-1039825049: creating Jun 19 04:14:25 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e2942169-039c-4f21-8c59-56570b6c90ab tempest-GroupSnapshotsTest-721679089 None] Group tempest-GroupSnapshotsTest-Group-1039825049: created successfully Jun 19 04:14:25 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e2942169-039c-4f21-8c59-56570b6c90ab tempest-GroupSnapshotsTest-721679089 None] Create group completed successfully. Jun 19 04:14:25 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-696a60ad-d34a-4495-a3a0-508982732471 req-4a0860ff-9529-42d5-b80c-311e7395e0f7 tempest-TaggedAttachmentsTest-1952420932 None] Terminate volume connection completed successfully. Jun 19 04:14:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-696a60ad-d34a-4495-a3a0-508982732471 req-4a0860ff-9529-42d5-b80c-311e7395e0f7 tempest-TaggedAttachmentsTest-1952420932 None] Deleting attachment 4e85a27a-95a0-495d-b2bd-dd493e57372f. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Flow 'volume_create_manager' (9d945db7-84bf-4b4c-b99f-87d122dd5e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8abde37-8759-41ae-9cee-a5ab6f9c847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8abde37-8759-41ae-9cee-a5ab6f9c847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1538718249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8b9b75-54f7-40c0-bc71-8c3f0e57c768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876f3cd2f64a4b54bdfcd959db69e936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:27Z,use_quota=True,user_id='a9f7c1010e864e97b988669ffc76ee22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac6ea05-7ba7-43a5-aad2-6928b776a434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac6ea05-7ba7-43a5-aad2-6928b776a434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef139af3-8198-4495-b6a5-2a5104bf0290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef139af3-8198-4495-b6a5-2a5104bf0290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d8b9b75-54f7-40c0-bc71-8c3f0e57c768', 'volume_name': 'volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870239e5-3658-4a21-977b-07470f1df6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870239e5-3658-4a21-977b-07470f1df6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ddd7ec5-a768-4032-9f4a-8ea7c1f2fde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:26 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Volume 2d8b9b75-54f7-40c0-bc71-8c3f0e57c768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768', 'volume_size': 1} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1538718249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8b9b75-54f7-40c0-bc71-8c3f0e57c768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876f3cd2f64a4b54bdfcd959db69e936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:27Z,use_quota=True,user_id='a9f7c1010e864e97b988669ffc76ee22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Creating volume 2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:14:26 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:14:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:26 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 1073741824 Jun 19 04:14:26 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:27 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:14:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Flow 'volume_create_manager' (33c1609e-16a2-4c5c-8d8c-a809bae0fa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2245530c-1e06-4a47-a2b8-07a7df52d6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2245530c-1e06-4a47-a2b8-07a7df52d6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-939655214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa7061a3-1d1b-4eb4-bef9-8a0199a286b7,host='devstack@QuobyteHD#QuobyteHD',id=2ae15403-94d6-4634-a74d-0caf184c8c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d39bed38ff4768a736a611beb8d231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:27Z,use_quota=True,user_id='7ad474ac50324140a717e7b36e8df2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9c63472-2804-4036-9115-3e99d9b6cdba),volume_type_id=a9c63472-2804-4036-9115-3e99d9b6cdba)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805212f2-42f2-4ffa-9969-40890b301168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805212f2-42f2-4ffa-9969-40890b301168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b76f67c-38a5-412a-a06d-97865c3d3390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b76f67c-38a5-412a-a06d-97865c3d3390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae15403-94d6-4634-a74d-0caf184c8c51', 'volume_name': 'volume-2ae15403-94d6-4634-a74d-0caf184c8c51', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5012f29-170b-4631-a610-2d48bd9ac51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5012f29-170b-4631-a610-2d48bd9ac51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea0cee8-262e-4e3d-a4e0-7af5699a77e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:27 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Volume 2ae15403-94d6-4634-a74d-0caf184c8c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae15403-94d6-4634-a74d-0caf184c8c51', 'volume_size': 1} Jun 19 04:14:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:28 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 1073741824" returned: 0 in 1.323s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:28 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 Jun 19 04:14:28 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:29 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768" returned: 0 in 0.895s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] <== create_volume: return (2261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.413s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa7061a3-1d1b-4eb4-bef9-8a0199a286b7,created_at=2026-06-19T02:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-939655214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa7061a3-1d1b-4eb4-bef9-8a0199a286b7,host='devstack@QuobyteHD#QuobyteHD',id=2ae15403-94d6-4634-a74d-0caf184c8c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d39bed38ff4768a736a611beb8d231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:27Z,use_quota=True,user_id='7ad474ac50324140a717e7b36e8df2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9c63472-2804-4036-9115-3e99d9b6cdba),volume_type_id=a9c63472-2804-4036-9115-3e99d9b6cdba)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Creating volume 2ae15403-94d6-4634-a74d-0caf184c8c51 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:14:29 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ddd7ec5-a768-4032-9f4a-8ea7c1f2fde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:29 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51 1073741824 Jun 19 04:14:29 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db515cc-da96-4b92-90c0-017e5e8581d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:29 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Volume volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 (2d8b9b75-54f7-40c0-bc71-8c3f0e57c768): created successfully Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db515cc-da96-4b92-90c0-017e5e8581d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Flow 'volume_create_manager' (9d945db7-84bf-4b4c-b99f-87d122dd5e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:29 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-6cd35f85-bbdc-4f4e-ba0e-0cb8b8166dea tempest-ServerActionsTestOtherA-1972692993 None] Created volume successfully. Jun 19 04:14:30 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51 1073741824" returned: 0 in 1.139s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:30 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51 Jun 19 04:14:30 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:30 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51" returned: 0 in 0.727s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:14:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea0cee8-262e-4e3d-a4e0-7af5699a77e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae15403-94d6-4634-a74d-0caf184c8c51', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36a333f-9105-4312-9aed-a78e3dcd5c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:31 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Volume volume-2ae15403-94d6-4634-a74d-0caf184c8c51 (2ae15403-94d6-4634-a74d-0caf184c8c51): created successfully Jun 19 04:14:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36a333f-9105-4312-9aed-a78e3dcd5c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Flow 'volume_create_manager' (33c1609e-16a2-4c5c-8d8c-a809bae0fa2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:31 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-848289d5-85b4-4602-a4cc-e40dc2c83b1d tempest-GroupSnapshotsTest-721679089 None] Created volume successfully. Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Flow 'volume_create_manager' (81608445-c910-46f9-9f80-ad7d4e67a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da599067-f3b1-47a3-8b95-de554fd5ff07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da599067-f3b1-47a3-8b95-de554fd5ff07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1831739719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa7061a3-1d1b-4eb4-bef9-8a0199a286b7,host='devstack@QuobyteHD#QuobyteHD',id=9e1512f1-b518-4453-a902-02ae09039388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d39bed38ff4768a736a611beb8d231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:32Z,use_quota=True,user_id='7ad474ac50324140a717e7b36e8df2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9c63472-2804-4036-9115-3e99d9b6cdba),volume_type_id=a9c63472-2804-4036-9115-3e99d9b6cdba)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6cc77f-cf86-4e89-9a64-c395c9889d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6cc77f-cf86-4e89-9a64-c395c9889d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3ab679-c028-4538-9e63-11296dfddb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3ab679-c028-4538-9e63-11296dfddb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e1512f1-b518-4453-a902-02ae09039388', 'volume_name': 'volume-9e1512f1-b518-4453-a902-02ae09039388', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebad323-88c9-4828-98af-7b4e599110bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebad323-88c9-4828-98af-7b4e599110bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af70a32c-e2d9-4094-8000-9cadbc519e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:32 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Volume 9e1512f1-b518-4453-a902-02ae09039388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e1512f1-b518-4453-a902-02ae09039388', 'volume_size': 1} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa7061a3-1d1b-4eb4-bef9-8a0199a286b7,created_at=2026-06-19T02:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1831739719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa7061a3-1d1b-4eb4-bef9-8a0199a286b7,host='devstack@QuobyteHD#QuobyteHD',id=9e1512f1-b518-4453-a902-02ae09039388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d39bed38ff4768a736a611beb8d231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:32Z,use_quota=True,user_id='7ad474ac50324140a717e7b36e8df2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9c63472-2804-4036-9115-3e99d9b6cdba),volume_type_id=a9c63472-2804-4036-9115-3e99d9b6cdba)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Creating volume 9e1512f1-b518-4453-a902-02ae09039388 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:14:32 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:32 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388 1073741824 Jun 19 04:14:32 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-7dcd8305-2d04-4207-8e05-1567ebe27e97 req-cea596f7-6669-4a09-99bd-a5fb2abdd1ca tempest-AttachVolumeShelveTestJSON-1318300943 None] No connector for attachment 278b2f2a-531a-4dd4-b19e-6e9e13ae6a2c; skipping storage backend terminate_connection call. {{(pid=93300) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 19 04:14:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-7dcd8305-2d04-4207-8e05-1567ebe27e97 req-cea596f7-6669-4a09-99bd-a5fb2abdd1ca tempest-AttachVolumeShelveTestJSON-1318300943 None] Deleting attachment 278b2f2a-531a-4dd4-b19e-6e9e13ae6a2c. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:14:33 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388 1073741824" returned: 0 in 1.040s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:33 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388 Jun 19 04:14:33 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:34 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388" returned: 0 in 0.803s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:14:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af70a32c-e2d9-4094-8000-9cadbc519e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1512f1-b518-4453-a902-02ae09039388', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15479ab6-2f98-469c-98b1-528e165f1f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:34 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Volume volume-9e1512f1-b518-4453-a902-02ae09039388 (9e1512f1-b518-4453-a902-02ae09039388): created successfully Jun 19 04:14:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15479ab6-2f98-469c-98b1-528e165f1f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Flow 'volume_create_manager' (81608445-c910-46f9-9f80-ad7d4e67a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:34 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4fb2ce3e-cd5b-4506-afb3-24127c892751 tempest-GroupSnapshotsTest-721679089 None] Created volume successfully. Jun 19 04:14:35 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-00634d37-cccb-42ab-9b35-c07a2a1f50ca tempest-GroupSnapshotsTest-721679089 None] Update group completed successfully. Jun 19 04:14:36 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ab288e9a-440a-4faf-ad71-241f6f5f8780 tempest-GroupSnapshotsTest-721679089 None] Update group completed successfully. Jun 19 04:14:37 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-22c27892-241e-4d9a-8985-57a1b9ee4764 tempest-GroupSnapshotsTest-721679089 None] Update group completed successfully. Jun 19 04:14:38 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b48d170b-88ce-4c86-b4e1-4872733e3ca3 tempest-GroupSnapshotsTest-721679089 None] Update group completed successfully. Jun 19 04:14:40 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] GroupSnapshot 97246f87-62c4-44f5-be4f-a5c2ad5a0fd8: creating. Jun 19 04:14:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Group snapshot 97246f87-62c4-44f5-be4f-a5c2ad5a0fd8: creating. {{(pid=93300) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 19 04:14:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Creating offline snapshot 4e783d92-e078-4ec7-b39e-392a2cb4a6de of volume 9e1512f1-b518-4453-a902-02ae09039388 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:14:40 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0f0993-fa8c-4abd-a2a7-6dac5777c001]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:40 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388 Jun 19 04:14:40 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:41 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388" returned: 0 in 0.847s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:41 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de 1G Jun 19 04:14:41 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:42 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de 1G" returned: 0 in 0.930s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e1512f1-b518-4453-a902-02ae09039388 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:42 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e1512f1-b518-4453-a902-02ae09039388 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de Jun 19 04:14:42 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:42 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e1512f1-b518-4453-a902-02ae09039388 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de" returned: 0 in 0.691s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:42 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:14:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:43 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de Jun 19 04:14:43 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:43 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de" returned: 0 in 0.850s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:43 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.info Jun 19 04:14:43 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:44 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.info" returned: 0 in 1.046s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:44 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:14:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:45 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.info Jun 19 04:14:45 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:46 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.info" returned: 0 in 1.174s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.708s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Creating offline snapshot 673381e7-4554-4bcf-8adf-18a735b7957d of volume 2ae15403-94d6-4634-a74d-0caf184c8c51 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:14:46 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bdfa88-d9b7-4817-ae96-7e2d9ea3285d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:46 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51 Jun 19 04:14:46 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Acquiring lock "cinder-8362c3dd-7502-4ae1-b727-b7c9e036af62-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:14:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Lock "cinder-8362c3dd-7502-4ae1-b727-b7c9e036af62-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:14:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Acquiring lock "cinder-quobyte-8362c3dd-7502-4ae1-b727-b7c9e036af62" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:14:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Lock "cinder-quobyte-8362c3dd-7502-4ae1-b727-b7c9e036af62" acquired by "delete_volume" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:14:47 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2712d9f3-043d-46be-9320-0a80430d97a3]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:47 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51" returned: 0 in 1.527s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:47 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d 1G Jun 19 04:14:47 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:47 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62 Jun 19 04:14:47 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:49 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62" returned: 0 in 1.282s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:49 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62 Jun 19 04:14:49 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:49 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d 1G" returned: 0 in 1.423s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae15403-94d6-4634-a74d-0caf184c8c51 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:49 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae15403-94d6-4634-a74d-0caf184c8c51 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d Jun 19 04:14:49 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:50 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8362c3dd-7502-4ae1-b727-b7c9e036af62" returned: 0 in 1.113s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Lock "cinder-quobyte-8362c3dd-7502-4ae1-b727-b7c9e036af62" released by "delete_volume" :: held 2.473s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:14:50 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Created reservations ['cf359a6e-acdf-470a-8826-14915336724a', '31e1711f-b60c-4d55-9d49-84dea1159ca2', '0cff792e-8e9c-40ce-a2ac-a4b3433097d7', '9a4905c0-291a-4a1f-835e-14d8ef47775a'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:14:50 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae15403-94d6-4634-a74d-0caf184c8c51 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d" returned: 0 in 1.054s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:50 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:14:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:50 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d Jun 19 04:14:50 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:50 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:14:50 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:51 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.007s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:51 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:14:51 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Deleted volume successfully. Jun 19 04:14:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fa8bd5ca-009d-4132-819f-9be9be38575a tempest-TaggedAttachmentsTest-1952420932 None] Lock "cinder-8362c3dd-7502-4ae1-b727-b7c9e036af62-delete_volume" released by "delete_volume" :: held 3.839s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:14:51 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d" returned: 0 in 1.195s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:51 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.info Jun 19 04:14:51 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:52 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.info" returned: 0 in 0.843s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:52 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:14:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:52 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.info Jun 19 04:14:52 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:53 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.info" returned: 0 in 0.965s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.168s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:53 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-fd14a9a3-f45b-4637-bc7c-133d170b967d tempest-GroupSnapshotsTest-721679089 None] group_snapshot 97246f87-62c4-44f5-be4f-a5c2ad5a0fd8: created successfully Jun 19 04:14:54 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] group_snapshot 97246f87-62c4-44f5-be4f-a5c2ad5a0fd8: deleting Jun 19 04:14:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] group_snapshot 97246f87-62c4-44f5-be4f-a5c2ad5a0fd8: deleting {{(pid=93300) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 19 04:14:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-9e1512f1-b518-4453-a902-02ae09039388" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:14:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-9e1512f1-b518-4453-a902-02ae09039388" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:14:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-4e783d92-e078-4ec7-b39e-392a2cb4a6de" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:14:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-4e783d92-e078-4ec7-b39e-392a2cb4a6de" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:14:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Deleting offline snapshot 4e783d92-e078-4ec7-b39e-392a2cb4a6de of volume 9e1512f1-b518-4453-a902-02ae09039388 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:14:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] snapshot_file for this snap is: volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:14:54 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f35d387-e0a5-456c-bac9-780dda41e7c1]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:55 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de Jun 19 04:14:55 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:56 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de" returned: 0 in 1.407s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e1512f1-b518-4453-a902-02ae09039388(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:14:56 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6182c577-3f5a-4735-9c07-8116cab24f8e]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:56 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388 Jun 19 04:14:56 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:58 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388" returned: 0 in 1.910s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:58 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de Jun 19 04:14:58 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:59 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de" returned: 0 in 1.164s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:59 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de Jun 19 04:14:59 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:00 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388.4e783d92-e078-4ec7-b39e-392a2cb4a6de" returned: 0 in 1.045s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-4e783d92-e078-4ec7-b39e-392a2cb4a6de" released by "_delete_snapshot" :: held 5.740s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-9e1512f1-b518-4453-a902-02ae09039388" released by "delete_snapshot" :: held 5.778s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-2ae15403-94d6-4634-a74d-0caf184c8c51" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-2ae15403-94d6-4634-a74d-0caf184c8c51" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-673381e7-4554-4bcf-8adf-18a735b7957d" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-673381e7-4554-4bcf-8adf-18a735b7957d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Deleting offline snapshot 673381e7-4554-4bcf-8adf-18a735b7957d of volume 2ae15403-94d6-4634-a74d-0caf184c8c51 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:15:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] snapshot_file for this snap is: volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:15:00 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c552df-26ef-468c-b554-8bcf4c1281e1]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:00 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d Jun 19 04:15:00 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:01 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d" returned: 0 in 0.876s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ae15403-94d6-4634-a74d-0caf184c8c51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:15:01 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d81a709-bead-403d-83f8-8171d18338a8]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:01 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51 Jun 19 04:15:01 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:02 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51" returned: 0 in 0.945s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:02 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d Jun 19 04:15:02 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:03 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d" returned: 0 in 0.779s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:03 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d Jun 19 04:15:03 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:04 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51.673381e7-4554-4bcf-8adf-18a735b7957d" returned: 0 in 0.775s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-673381e7-4554-4bcf-8adf-18a735b7957d" released by "_delete_snapshot" :: held 3.500s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-2ae15403-94d6-4634-a74d-0caf184c8c51" released by "delete_snapshot" :: held 3.528s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:04 devstack cinder-volume[93300]: WARNING cinder.quota [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-99684557 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-99684557, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:15:04 devstack cinder-volume[93300]: WARNING cinder.quota [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-99684557 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-99684557, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:15:04 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Created reservations ['c1abd893-2d6a-4794-8846-6beabfc917df', '69de556c-c60a-4ebe-bb04-f1423edb6e1c', '90a8522a-3c22-4e70-8e65-5555cb127908', 'd8c3b83e-781a-4228-9285-85cf7dacfb50'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:04 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] Created reservations ['bbcfa76b-ee0d-4c52-adff-aa8809e791d7', 'a30b33c2-b149-4896-a526-c4f341c4858a', '40fb6fcb-6d08-4313-b42c-cd524c6440a1', '7f3de192-9b28-40e4-aa9b-358f7ed1e18f'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:04 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-26e3409d-ce64-41c3-9845-3078dfe1a62b tempest-GroupSnapshotsTest-721679089 None] group_snapshot 97246f87-62c4-44f5-be4f-a5c2ad5a0fd8: deleted successfully Jun 19 04:15:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-2ae15403-94d6-4634-a74d-0caf184c8c51" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-2ae15403-94d6-4634-a74d-0caf184c8c51" acquired by "delete_volume" :: waited 0.035s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:05 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4acfdb-9b6a-4131-b20a-4f66ec02fa98]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:06 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51 Jun 19 04:15:06 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:06 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51" returned: 0 in 1.005s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:06 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51 Jun 19 04:15:06 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:07 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2ae15403-94d6-4634-a74d-0caf184c8c51" returned: 0 in 0.759s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-2ae15403-94d6-4634-a74d-0caf184c8c51" released by "delete_volume" :: held 1.848s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-9e1512f1-b518-4453-a902-02ae09039388" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-9e1512f1-b518-4453-a902-02ae09039388" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:07 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fda02b-dd40-44f5-b098-a34968fd8c80]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:07 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388 Jun 19 04:15:07 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:08 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388" returned: 0 in 0.894s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:08 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388 Jun 19 04:15:08 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:09 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e1512f1-b518-4453-a902-02ae09039388" returned: 0 in 0.819s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-9e1512f1-b518-4453-a902-02ae09039388" released by "delete_volume" :: held 1.790s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:09 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=84,cinder:UPDATE=66,cinder:INSERT=16,cinder:DELETE=4 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:15:09 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=78,cinder:SELECT=71,cinder:INSERT=16,cinder:DELETE=1 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:15:09 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Created reservations ['9ac87a7c-06db-4c72-ab5b-4d7517dec8ed'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:09 devstack cinder-volume[93300]: WARNING cinder.quota [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-99684557 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-99684557, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:15:09 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Created reservations ['9a0bae70-e9a8-40c6-8b29-40e94c8e7f23', '50181671-3df4-408c-8926-029653c87b7c', '76c3ea20-c181-437d-9817-7b3c087b35f4', '1a0cd40b-1281-430e-a5cb-083dc86d6159'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:09 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Created reservations ['35cf9e8d-b61e-4827-8477-6fd86547e454', '14a7db5a-b454-4780-9399-66fb78c78c12', '2077be1f-6b61-4474-913b-a1e308e8934d', '97e585ca-e4cd-448e-a931-a3ceec321408'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:10 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:10 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:10 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:15:10 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:10 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.822s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:10 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:15:10 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-7fefc335-73df-41c0-a6eb-2bc8d0a22872 tempest-GroupSnapshotsTest-721679089 None] Delete group completed successfully. Jun 19 04:15:11 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-716f3e2a-e7e9-42c3-9e45-c9975c231ed5 tempest-GroupSnapshotsTest-721679089 None] Group tempest-GroupSnapshotsTest-Group-1443753976: creating Jun 19 04:15:11 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-716f3e2a-e7e9-42c3-9e45-c9975c231ed5 tempest-GroupSnapshotsTest-721679089 None] Group tempest-GroupSnapshotsTest-Group-1443753976: created successfully Jun 19 04:15:11 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-716f3e2a-e7e9-42c3-9e45-c9975c231ed5 tempest-GroupSnapshotsTest-721679089 None] Create group completed successfully. Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Flow 'volume_create_manager' (6e521bde-8227-483b-84ce-09eb0d8c651b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce7a99f-efdb-4958-81b3-db4eb063589f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce7a99f-efdb-4958-81b3-db4eb063589f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-589497043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da11459f-2948-4341-a032-2a8a52b87c29,host='devstack@QuobyteHD#QuobyteHD',id=eb0b84ee-7ed1-4843-b6e4-494163143399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d39bed38ff4768a736a611beb8d231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:15:13Z,use_quota=True,user_id='7ad474ac50324140a717e7b36e8df2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d28e432-2fc8-401e-b829-57ed5b41b475),volume_type_id=3d28e432-2fc8-401e-b829-57ed5b41b475)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3668dad6-618c-427c-bff2-7fbfeb21ce2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3668dad6-618c-427c-bff2-7fbfeb21ce2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aadaadd-969c-49b0-ae82-2190a6aeafc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aadaadd-969c-49b0-ae82-2190a6aeafc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0b84ee-7ed1-4843-b6e4-494163143399', 'volume_name': 'volume-eb0b84ee-7ed1-4843-b6e4-494163143399', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d17f5d-4bc9-4b6a-8403-ce11f852a78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d17f5d-4bc9-4b6a-8403-ce11f852a78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e293768-fe6b-49a1-9aa5-724da2abff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:13 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Volume eb0b84ee-7ed1-4843-b6e4-494163143399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0b84ee-7ed1-4843-b6e4-494163143399', 'volume_size': 1} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=da11459f-2948-4341-a032-2a8a52b87c29,created_at=2026-06-19T02:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-589497043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da11459f-2948-4341-a032-2a8a52b87c29,host='devstack@QuobyteHD#QuobyteHD',id=eb0b84ee-7ed1-4843-b6e4-494163143399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d39bed38ff4768a736a611beb8d231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:15:13Z,use_quota=True,user_id='7ad474ac50324140a717e7b36e8df2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d28e432-2fc8-401e-b829-57ed5b41b475),volume_type_id=3d28e432-2fc8-401e-b829-57ed5b41b475)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Creating volume eb0b84ee-7ed1-4843-b6e4-494163143399 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:15:13 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:13 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399 1073741824 Jun 19 04:15:13 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-753a87a7-897d-4ea1-b9be-93e4400d1243 req-75a25516-c62a-4e01-8909-5a224579bf2c tempest-ServerActionsTestOtherA-1972692993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:14 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399 1073741824" returned: 0 in 0.919s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:14 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399 Jun 19 04:15:14 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399" returned: 0 in 0.751s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:15:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-753a87a7-897d-4ea1-b9be-93e4400d1243 req-75a25516-c62a-4e01-8909-5a224579bf2c tempest-ServerActionsTestOtherA-1972692993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.556s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:15 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e293768-fe6b-49a1-9aa5-724da2abff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0b84ee-7ed1-4843-b6e4-494163143399', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38a2c4b-3787-44ba-9bab-bd7991fd484c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:15 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[061ff7d3-1eb5-4deb-9056-ba7906b2cd55]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-753a87a7-897d-4ea1-b9be-93e4400d1243 req-75a25516-c62a-4e01-8909-5a224579bf2c tempest-ServerActionsTestOtherA-1972692993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:15 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Volume volume-eb0b84ee-7ed1-4843-b6e4-494163143399 (eb0b84ee-7ed1-4843-b6e4-494163143399): created successfully Jun 19 04:15:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38a2c4b-3787-44ba-9bab-bd7991fd484c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Flow 'volume_create_manager' (6e521bde-8227-483b-84ce-09eb0d8c651b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:15:15 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c6ad6b3c-ce94-4516-8d5d-5417d2f14e88 tempest-GroupSnapshotsTest-721679089 None] Created volume successfully. Jun 19 04:15:15 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 Jun 19 04:15:15 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:16 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-753a87a7-897d-4ea1-b9be-93e4400d1243 req-75a25516-c62a-4e01-8909-5a224579bf2c tempest-ServerActionsTestOtherA-1972692993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768" returned: 0 in 0.799s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-753a87a7-897d-4ea1-b9be-93e4400d1243 req-75a25516-c62a-4e01-8909-5a224579bf2c tempest-ServerActionsTestOtherA-1972692993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.846s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-753a87a7-897d-4ea1-b9be-93e4400d1243 req-75a25516-c62a-4e01-8909-5a224579bf2c tempest-ServerActionsTestOtherA-1972692993 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9cf58658-4fe1-474b-bd9a-a9f82d747a2e', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:15:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] GroupSnapshot 1b1478b5-776f-41d4-9864-cdc66eafc12a: creating. Jun 19 04:15:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] Group snapshot 1b1478b5-776f-41d4-9864-cdc66eafc12a: creating. {{(pid=93300) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 19 04:15:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] Creating offline snapshot f9a5899f-4642-42b6-b5fa-d0574debef63 of volume eb0b84ee-7ed1-4843-b6e4-494163143399 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:15:16 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bc8a83-fd38-4215-89ae-cffbbcd59453]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-753a87a7-897d-4ea1-b9be-93e4400d1243 req-75a25516-c62a-4e01-8909-5a224579bf2c tempest-ServerActionsTestOtherA-1972692993 None] attachment_update completed successfully. Jun 19 04:15:16 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399 Jun 19 04:15:16 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:17 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399" returned: 0 in 0.963s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:17 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 1G Jun 19 04:15:17 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:18 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 1G" returned: 0 in 1.049s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0b84ee-7ed1-4843-b6e4-494163143399 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:18 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0b84ee-7ed1-4843-b6e4-494163143399 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 Jun 19 04:15:18 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:19 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:19 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:15:19 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0b84ee-7ed1-4843-b6e4-494163143399 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63" returned: 0 in 0.874s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:19 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:19 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 Jun 19 04:15:19 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:19 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.690s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 8 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:15:19 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63" returned: 0 in 0.740s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:20 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.info Jun 19 04:15:20 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:20 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.info" returned: 0 in 0.798s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:20 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:15:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:20 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.info Jun 19 04:15:20 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:21 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.info" returned: 0 in 0.747s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.313s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:21 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-638dc12d-8b6a-48a3-aeaf-0c2694bdc1b2 tempest-GroupSnapshotsTest-721679089 None] group_snapshot 1b1478b5-776f-41d4-9864-cdc66eafc12a: created successfully Jun 19 04:15:22 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] group_snapshot 1b1478b5-776f-41d4-9864-cdc66eafc12a: deleting Jun 19 04:15:22 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] group_snapshot 1b1478b5-776f-41d4-9864-cdc66eafc12a: deleting {{(pid=93300) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 19 04:15:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-eb0b84ee-7ed1-4843-b6e4-494163143399" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-eb0b84ee-7ed1-4843-b6e4-494163143399" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-f9a5899f-4642-42b6-b5fa-d0574debef63" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-f9a5899f-4642-42b6-b5fa-d0574debef63" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:22 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Deleting offline snapshot f9a5899f-4642-42b6-b5fa-d0574debef63 of volume eb0b84ee-7ed1-4843-b6e4-494163143399 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:15:22 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] snapshot_file for this snap is: volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:15:22 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1043b11-8654-4729-b9f2-8a06ef9cc0d7]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:23 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 Jun 19 04:15:23 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:24 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63" returned: 0 in 1.195s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:24 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb0b84ee-7ed1-4843-b6e4-494163143399(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:15:24 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4024fd-8a3d-4194-8fee-458110b63db0]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:24 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399 Jun 19 04:15:24 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:25 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399" returned: 0 in 1.300s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:25 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 Jun 19 04:15:25 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:25 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-ec473536-a942-42da-92b4-0c67aecadcf3 req-4c71950f-04d2-4f4c-95ad-960e628f2a6c tempest-ServerActionsTestOtherA-1972692993 None] Terminate volume connection completed successfully. Jun 19 04:15:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-ec473536-a942-42da-92b4-0c67aecadcf3 req-4c71950f-04d2-4f4c-95ad-960e628f2a6c tempest-ServerActionsTestOtherA-1972692993 None] Deleting attachment 9cf58658-4fe1-474b-bd9a-a9f82d747a2e. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:15:26 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63" returned: 0 in 0.881s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:26 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63 Jun 19 04:15:26 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:27 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399.f9a5899f-4642-42b6-b5fa-d0574debef63" returned: 0 in 0.678s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-f9a5899f-4642-42b6-b5fa-d0574debef63" released by "_delete_snapshot" :: held 4.210s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-eb0b84ee-7ed1-4843-b6e4-494163143399" released by "delete_snapshot" :: held 4.238s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:27 devstack cinder-volume[93300]: WARNING cinder.quota [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1868218877 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1868218877, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:15:27 devstack cinder-volume[93300]: WARNING cinder.quota [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1868218877 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1868218877, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:15:27 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] Created reservations ['283d011c-8c2d-46ab-a6cf-dc855567352b', '98c9f8c3-c745-4e94-b545-4da940b0551b', '07c3a575-2b44-4bfd-91a8-69aee8c6824e', '767b101d-9c45-4e7c-b19b-53a028c81a43'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:27 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-444c0409-cc08-48a2-9a53-622b32b960b6 tempest-GroupSnapshotsTest-721679089 None] group_snapshot 1b1478b5-776f-41d4-9864-cdc66eafc12a: deleted successfully Jun 19 04:15:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "cinder-quobyte-eb0b84ee-7ed1-4843-b6e4-494163143399" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-eb0b84ee-7ed1-4843-b6e4-494163143399" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:27 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[24066298-25df-4979-ab21-5df69e6befde]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:27 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399 Jun 19 04:15:27 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-ec473536-a942-42da-92b4-0c67aecadcf3 req-550d53d3-7f3e-4482-b8f7-fc8f9cc0afa8 tempest-ServerActionsTestOtherA-1972692993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-ec473536-a942-42da-92b4-0c67aecadcf3 req-550d53d3-7f3e-4482-b8f7-fc8f9cc0afa8 tempest-ServerActionsTestOtherA-1972692993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:28 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[548c43a3-9b7f-4981-ab1b-473f028bd566]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-ec473536-a942-42da-92b4-0c67aecadcf3 req-550d53d3-7f3e-4482-b8f7-fc8f9cc0afa8 tempest-ServerActionsTestOtherA-1972692993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:28 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 Jun 19 04:15:28 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:28 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399" returned: 0 in 0.985s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:28 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399 Jun 19 04:15:28 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:29 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-ec473536-a942-42da-92b4-0c67aecadcf3 req-550d53d3-7f3e-4482-b8f7-fc8f9cc0afa8 tempest-ServerActionsTestOtherA-1972692993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768" returned: 0 in 0.896s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-ec473536-a942-42da-92b4-0c67aecadcf3 req-550d53d3-7f3e-4482-b8f7-fc8f9cc0afa8 tempest-ServerActionsTestOtherA-1972692993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.931s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-ec473536-a942-42da-92b4-0c67aecadcf3 req-550d53d3-7f3e-4482-b8f7-fc8f9cc0afa8 tempest-ServerActionsTestOtherA-1972692993 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6097e765-bedb-4beb-a029-d84a31b5d992', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:15:29 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-ec473536-a942-42da-92b4-0c67aecadcf3 req-550d53d3-7f3e-4482-b8f7-fc8f9cc0afa8 tempest-ServerActionsTestOtherA-1972692993 None] attachment_update completed successfully. Jun 19 04:15:29 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-eb0b84ee-7ed1-4843-b6e4-494163143399" returned: 0 in 0.876s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Lock "cinder-quobyte-eb0b84ee-7ed1-4843-b6e4-494163143399" released by "delete_volume" :: held 1.951s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:29 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Created reservations ['57448322-7eae-47c6-80d0-47433dda101e'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:29 devstack cinder-volume[93300]: WARNING cinder.quota [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1868218877 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1868218877, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:15:29 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Created reservations ['944cb850-5210-4ef1-a04c-10f6bb5b9d34', 'fba44451-28ba-4564-85f5-a15242842b2d', 'ce96cb55-bd45-471a-a9d6-442421ef994a', '2cb52906-12fb-4cf1-9349-3ab5622c55e5'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:29 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:29 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:29 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:15:29 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:30 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.037s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:30 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:15:30 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b7ab12c7-6cf0-454d-8543-8563f752d009 tempest-GroupSnapshotsTest-721679089 None] Delete group completed successfully. Jun 19 04:15:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Acquiring lock "cinder-f053c724-7de7-44bf-894e-ccda629d5180-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Lock "cinder-f053c724-7de7-44bf-894e-ccda629d5180-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Acquiring lock "cinder-quobyte-f053c724-7de7-44bf-894e-ccda629d5180" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Lock "cinder-quobyte-f053c724-7de7-44bf-894e-ccda629d5180" acquired by "delete_volume" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:31 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79f78ef-e6f3-4bbb-9879-dcd7fac1fde5]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f053c724-7de7-44bf-894e-ccda629d5180 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:31 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f053c724-7de7-44bf-894e-ccda629d5180 Jun 19 04:15:31 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:32 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f053c724-7de7-44bf-894e-ccda629d5180" returned: 0 in 1.049s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f053c724-7de7-44bf-894e-ccda629d5180 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:32 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f053c724-7de7-44bf-894e-ccda629d5180 Jun 19 04:15:32 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:33 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f053c724-7de7-44bf-894e-ccda629d5180" returned: 0 in 0.869s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Lock "cinder-quobyte-f053c724-7de7-44bf-894e-ccda629d5180" released by "delete_volume" :: held 2.004s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:33 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Created reservations ['cd5204ea-0b98-40d1-9eb5-be25ee1325c4', '65ac9363-2129-4916-a768-8b698cc658f6', '5aa98ac6-e879-4554-88f3-401f5462a9eb', '61f34732-2345-4dcf-8da0-9701e93f9cf6'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:33 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:15:33 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:34 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.883s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:34 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:15:34 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Deleted volume successfully. Jun 19 04:15:34 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-add8df38-cc55-4a60-94ad-4bbdb2ece55c tempest-AttachVolumeShelveTestJSON-1318300943 None] Lock "cinder-f053c724-7de7-44bf-894e-ccda629d5180-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:37 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ff8dcf8a-59cd-4179-bf5c-4a99bf82d2c0 tempest-GroupSnapshotsV319Test-381588075 None] Group tempest-GroupSnapshotsV319Test-Group-2041725714: creating Jun 19 04:15:37 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ff8dcf8a-59cd-4179-bf5c-4a99bf82d2c0 tempest-GroupSnapshotsV319Test-381588075 None] Group tempest-GroupSnapshotsV319Test-Group-2041725714: created successfully Jun 19 04:15:37 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ff8dcf8a-59cd-4179-bf5c-4a99bf82d2c0 tempest-GroupSnapshotsV319Test-381588075 None] Create group completed successfully. Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Flow 'volume_create_manager' (cb89fa39-a004-4f47-b991-b1f8a1823710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f218c31b-708b-42e2-af7b-a6319594f000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f218c31b-708b-42e2-af7b-a6319594f000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1450488861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef4168a0-ce14-433a-bd79-7f98bc3679bf,host='devstack@QuobyteHD#QuobyteHD',id=71caaf3b-0401-4fd6-8429-b5c6b7f859e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab695e03cf54024a63b604c40cb08f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:15:40Z,use_quota=True,user_id='2c5635063c3042d8bdff193731f951cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c1aca61-3acf-45e5-957b-d20e83f4b7a5),volume_type_id=4c1aca61-3acf-45e5-957b-d20e83f4b7a5)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7161db94-d031-4c20-8307-0c66c327b0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7161db94-d031-4c20-8307-0c66c327b0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf280b11-de52-4fe8-bbf9-9dc8cc3338f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf280b11-de52-4fe8-bbf9-9dc8cc3338f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71caaf3b-0401-4fd6-8429-b5c6b7f859e1', 'volume_name': 'volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc34cf7-e28b-4640-94f1-627e26095dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc34cf7-e28b-4640-94f1-627e26095dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9fc5d6-588b-492c-b6e7-17bbbcb5d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:40 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Volume 71caaf3b-0401-4fd6-8429-b5c6b7f859e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1', 'volume_size': 1} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef4168a0-ce14-433a-bd79-7f98bc3679bf,created_at=2026-06-19T02:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1450488861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef4168a0-ce14-433a-bd79-7f98bc3679bf,host='devstack@QuobyteHD#QuobyteHD',id=71caaf3b-0401-4fd6-8429-b5c6b7f859e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab695e03cf54024a63b604c40cb08f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:15:40Z,use_quota=True,user_id='2c5635063c3042d8bdff193731f951cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c1aca61-3acf-45e5-957b-d20e83f4b7a5),volume_type_id=4c1aca61-3acf-45e5-957b-d20e83f4b7a5)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Creating volume 71caaf3b-0401-4fd6-8429-b5c6b7f859e1 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:15:40 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:15:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:40 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 1073741824 Jun 19 04:15:40 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:41 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 1073741824" returned: 0 in 1.789s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:42 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 Jun 19 04:15:42 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:42 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1" returned: 0 in 0.832s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] <== create_volume: return (2705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:15:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.711s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9fc5d6-588b-492c-b6e7-17bbbcb5d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1ac3e4-5b15-483a-88f1-035105ca4b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:42 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Volume volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 (71caaf3b-0401-4fd6-8429-b5c6b7f859e1): created successfully Jun 19 04:15:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1ac3e4-5b15-483a-88f1-035105ca4b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Flow 'volume_create_manager' (cb89fa39-a004-4f47-b991-b1f8a1823710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:15:43 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-71e9f270-0065-43d4-add8-7a234d059842 tempest-GroupSnapshotsV319Test-381588075 None] Created volume successfully. Jun 19 04:15:44 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] GroupSnapshot 3f538d49-8440-4894-bb7b-f66ac6ad5e98: creating. Jun 19 04:15:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] Group snapshot 3f538d49-8440-4894-bb7b-f66ac6ad5e98: creating. {{(pid=93300) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 19 04:15:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] Creating offline snapshot 11674684-1c67-4136-b9b3-c8d15db88709 of volume 71caaf3b-0401-4fd6-8429-b5c6b7f859e1 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:15:44 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21980f4-2b19-4bd1-a984-faee06a9d99d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:44 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 Jun 19 04:15:44 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:45 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1" returned: 0 in 1.148s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:45 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 1G Jun 19 04:15:45 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:47 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 1G" returned: 0 in 1.475s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:47 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 Jun 19 04:15:47 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:48 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709" returned: 0 in 0.802s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:48 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:15:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:48 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 Jun 19 04:15:48 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:49 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709" returned: 0 in 0.870s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:49 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.info Jun 19 04:15:49 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:49 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.info" returned: 0 in 0.759s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:49 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:15:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:49 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.info Jun 19 04:15:49 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:51 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.info" returned: 0 in 1.215s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.367s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:51 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-aadced67-1240-4520-bf64-470f006906f6 tempest-GroupSnapshotsV319Test-381588075 None] group_snapshot 3f538d49-8440-4894-bb7b-f66ac6ad5e98: created successfully Jun 19 04:15:52 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] group_snapshot 3f538d49-8440-4894-bb7b-f66ac6ad5e98: deleting Jun 19 04:15:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] group_snapshot 3f538d49-8440-4894-bb7b-f66ac6ad5e98: deleting {{(pid=93300) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 19 04:15:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Acquiring lock "cinder-quobyte-71caaf3b-0401-4fd6-8429-b5c6b7f859e1" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Lock "cinder-quobyte-71caaf3b-0401-4fd6-8429-b5c6b7f859e1" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Acquiring lock "cinder-quobyte-11674684-1c67-4136-b9b3-c8d15db88709" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Lock "cinder-quobyte-11674684-1c67-4136-b9b3-c8d15db88709" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Deleting offline snapshot 11674684-1c67-4136-b9b3-c8d15db88709 of volume 71caaf3b-0401-4fd6-8429-b5c6b7f859e1 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:15:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] snapshot_file for this snap is: volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:15:52 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[822fa90a-0dfc-4816-a099-28639e2a7ede]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:52 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 Jun 19 04:15:52 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:53 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709" returned: 0 in 1.412s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:15:53 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c274fc4-0e92-4fba-837d-5b124e9a9a03]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:54 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 Jun 19 04:15:54 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:55 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1" returned: 0 in 1.082s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:55 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 Jun 19 04:15:55 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:55 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709" returned: 0 in 0.870s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:55 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709 Jun 19 04:15:55 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:56 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1.11674684-1c67-4136-b9b3-c8d15db88709" returned: 0 in 0.635s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Lock "cinder-quobyte-11674684-1c67-4136-b9b3-c8d15db88709" released by "_delete_snapshot" :: held 4.169s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Lock "cinder-quobyte-71caaf3b-0401-4fd6-8429-b5c6b7f859e1" released by "delete_snapshot" :: held 4.217s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:56 devstack cinder-volume[93300]: WARNING cinder.quota [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1300928641 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1300928641, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:15:56 devstack cinder-volume[93300]: WARNING cinder.quota [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1300928641 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1300928641, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:15:56 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] Created reservations ['ef6df4e9-a1ca-413c-a5e4-72fa5782f4f4', 'c0d9ad9a-1e42-4808-b7af-6ad585e90141', 'b68c5903-491c-4345-a6cd-ed41be24d36d', '488f8f4f-a6bb-4014-9f15-e80f0639d989'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:56 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b147f8da-0389-4459-bc85-097bd7fdeec7 tempest-GroupSnapshotsV319Test-381588075 None] group_snapshot 3f538d49-8440-4894-bb7b-f66ac6ad5e98: deleted successfully Jun 19 04:15:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Acquiring lock "cinder-quobyte-71caaf3b-0401-4fd6-8429-b5c6b7f859e1" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Lock "cinder-quobyte-71caaf3b-0401-4fd6-8429-b5c6b7f859e1" acquired by "delete_volume" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:57 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be91310-acce-46d9-9751-116285a414ee]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:57 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 Jun 19 04:15:57 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:58 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1" returned: 0 in 0.890s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:58 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1 Jun 19 04:15:58 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:58 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-71caaf3b-0401-4fd6-8429-b5c6b7f859e1" returned: 0 in 0.642s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Lock "cinder-quobyte-71caaf3b-0401-4fd6-8429-b5c6b7f859e1" released by "delete_volume" :: held 1.620s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:58 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Created reservations ['83ca6fc4-e61c-4a9f-a615-4f083a0778e5'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:58 devstack cinder-volume[93300]: WARNING cinder.quota [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1300928641 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1300928641, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:15:58 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Created reservations ['a97498ac-5748-40a4-aab9-b243fdd4832f', '6ee040d7-4dcd-4810-add1-3c393aedf669', 'f03270dd-781b-43a8-8373-8332a7559e03', '51f903c3-5f60-4b14-98b8-95440b08fad2'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:58 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:58 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:59 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:15:59 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:59 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.880s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:59 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:15:59 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-6175ba3c-fdb7-4c35-b369-57f1bb773c2c tempest-GroupSnapshotsV319Test-381588075 None] Delete group completed successfully. Jun 19 04:16:04 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-d898a067-5be7-4322-9da1-2e1810ff32a3 req-9df3ec72-2f5d-487a-8816-8424b29d3a2b tempest-ServerActionsTestOtherA-1972692993 None] Terminate volume connection completed successfully. Jun 19 04:16:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-d898a067-5be7-4322-9da1-2e1810ff32a3 req-9df3ec72-2f5d-487a-8816-8424b29d3a2b tempest-ServerActionsTestOtherA-1972692993 None] Deleting attachment 6097e765-bedb-4beb-a029-d84a31b5d992. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Flow 'volume_create_manager' (4de704cc-e452-4822-8fde-935769293268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de85777-2a70-4e44-bd48-62ba655b5304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de85777-2a70-4e44-bd48-62ba655b5304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1644170798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebfdf77-3b7b-4ff8-9f09-146e4a788df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d0e6c92a4540f79531cbf8275f6683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:05Z,use_quota=True,user_id='41e97d44b6a946709ef0296861669188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee603e2-e78c-4089-9741-0f5049b09474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee603e2-e78c-4089-9741-0f5049b09474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (942ac19c-f973-444c-a447-dbbee9c5f625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (942ac19c-f973-444c-a447-dbbee9c5f625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ebfdf77-3b7b-4ff8-9f09-146e4a788df2', 'volume_name': 'volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd471762-a872-410d-aecd-c48206ef88f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd471762-a872-410d-aecd-c48206ef88f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60a5520-dacb-40b3-a488-f6cf457388ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:05 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Volume 7ebfdf77-3b7b-4ff8-9f09-146e4a788df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2', 'volume_size': 1} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1644170798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebfdf77-3b7b-4ff8-9f09-146e4a788df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d0e6c92a4540f79531cbf8275f6683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:05Z,use_quota=True,user_id='41e97d44b6a946709ef0296861669188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Creating volume 7ebfdf77-3b7b-4ff8-9f09-146e4a788df2 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:16:05 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:16:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:05 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2 1073741824 Jun 19 04:16:05 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:05 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-cb818ecc-561a-4d0a-876f-04a1ccc747cc tempest-GroupsV320Test-58567067 None] Group tempest-GroupsV320Test-Group-862014456: creating Jun 19 04:16:05 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-cb818ecc-561a-4d0a-876f-04a1ccc747cc tempest-GroupsV320Test-58567067 None] Group tempest-GroupsV320Test-Group-862014456: created successfully Jun 19 04:16:05 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-cb818ecc-561a-4d0a-876f-04a1ccc747cc tempest-GroupsV320Test-58567067 None] Create group completed successfully. Jun 19 04:16:06 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2 1073741824" returned: 0 in 0.913s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:06 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2 Jun 19 04:16:06 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:06 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2" returned: 0 in 0.642s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:16:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60a5520-dacb-40b3-a488-f6cf457388ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f371d99d-58cd-42fb-9c8b-d95081f97069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:06 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Volume volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2 (7ebfdf77-3b7b-4ff8-9f09-146e4a788df2): created successfully Jun 19 04:16:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f371d99d-58cd-42fb-9c8b-d95081f97069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Flow 'volume_create_manager' (4de704cc-e452-4822-8fde-935769293268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:06 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2317a6e4-e1c1-48eb-8a74-4989a3947e54 tempest-AttachVolumeNegativeTest-1515607248 None] Created volume successfully. Jun 19 04:16:07 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-16f599b6-d9a6-4e47-bf69-473eeabd5a15 tempest-GroupsV320Test-58567067 None] Created reservations ['deffd070-5f11-483b-9150-010e8a1614ec'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-16f599b6-d9a6-4e47-bf69-473eeabd5a15 tempest-GroupsV320Test-58567067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-16f599b6-d9a6-4e47-bf69-473eeabd5a15 tempest-GroupsV320Test-58567067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-16f599b6-d9a6-4e47-bf69-473eeabd5a15 tempest-GroupsV320Test-58567067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-16f599b6-d9a6-4e47-bf69-473eeabd5a15 tempest-GroupsV320Test-58567067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-16f599b6-d9a6-4e47-bf69-473eeabd5a15 tempest-GroupsV320Test-58567067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-16f599b6-d9a6-4e47-bf69-473eeabd5a15 tempest-GroupsV320Test-58567067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:07 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:16:07 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:08 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-16f599b6-d9a6-4e47-bf69-473eeabd5a15 tempest-GroupsV320Test-58567067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.925s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:08 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-16f599b6-d9a6-4e47-bf69-473eeabd5a15 tempest-GroupsV320Test-58567067 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:16:08 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-16f599b6-d9a6-4e47-bf69-473eeabd5a15 tempest-GroupsV320Test-58567067 None] Delete group completed successfully. Jun 19 04:16:10 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=84,cinder:INSERT=18,cinder:UPDATE=72,cinder:DELETE=2 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:16:10 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=92,cinder:UPDATE=91,cinder:INSERT=19,cinder:DELETE=2 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:16:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-70ba664e-7f56-48b5-8a84-683032816b89 req-ea87b32f-be61-4d9b-b495-f7f38cbc514c tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-70ba664e-7f56-48b5-8a84-683032816b89 req-ea87b32f-be61-4d9b-b495-f7f38cbc514c tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:10 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[42981126-1843-4003-9134-f4f6253f97a0]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-70ba664e-7f56-48b5-8a84-683032816b89 req-ea87b32f-be61-4d9b-b495-f7f38cbc514c tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:10 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2 Jun 19 04:16:10 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:11 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-70ba664e-7f56-48b5-8a84-683032816b89 req-ea87b32f-be61-4d9b-b495-f7f38cbc514c tempest-AttachVolumeNegativeTest-1515607248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2" returned: 0 in 0.964s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-70ba664e-7f56-48b5-8a84-683032816b89 req-ea87b32f-be61-4d9b-b495-f7f38cbc514c tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.990s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:11 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-70ba664e-7f56-48b5-8a84-683032816b89 req-ea87b32f-be61-4d9b-b495-f7f38cbc514c tempest-AttachVolumeNegativeTest-1515607248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34e8ea79-512e-49d5-9bdc-5f1817574ee9', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:16:11 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-70ba664e-7f56-48b5-8a84-683032816b89 req-ea87b32f-be61-4d9b-b495-f7f38cbc514c tempest-AttachVolumeNegativeTest-1515607248 None] attachment_update completed successfully. Jun 19 04:16:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Acquiring lock "cinder-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Lock "cinder-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Acquiring lock "cinder-quobyte-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Lock "cinder-quobyte-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768" acquired by "delete_volume" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:14 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d16000-d0fa-462f-81f8-789d3dd45d13]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:14 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 Jun 19 04:16:14 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Flow 'volume_create_manager' (44cd00f5-685a-4eca-8ca8-38dbc6c952bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae62f393-08d3-49ed-a739-9c5411c50412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae62f393-08d3-49ed-a739-9c5411c50412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1060217949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e285ca97-6f24-47f5-a89f-a8a03b347736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d55e35c076451db00c0e6b51f58cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:15Z,use_quota=True,user_id='1d9c6f64f20440b1b9fef1cef58ebee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40595135-ae86-46d1-9cae-9220252be7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40595135-ae86-46d1-9cae-9220252be7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8adfee-8a4a-4e11-9f9d-54c28fe81ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8adfee-8a4a-4e11-9f9d-54c28fe81ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e285ca97-6f24-47f5-a89f-a8a03b347736', 'volume_name': 'volume-e285ca97-6f24-47f5-a89f-a8a03b347736', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a54626b8-cd83-44f1-9682-4db2204089bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a54626b8-cd83-44f1-9682-4db2204089bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1b31ac-be8d-4254-8f30-b378b836eb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:15 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Volume e285ca97-6f24-47f5-a89f-a8a03b347736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e285ca97-6f24-47f5-a89f-a8a03b347736', 'volume_size': 1} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1060217949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e285ca97-6f24-47f5-a89f-a8a03b347736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d55e35c076451db00c0e6b51f58cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:15Z,use_quota=True,user_id='1d9c6f64f20440b1b9fef1cef58ebee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Creating volume e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:16:15 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:15 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736 1073741824 Jun 19 04:16:15 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:15 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768" returned: 0 in 0.833s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:15 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768 Jun 19 04:16:15 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:16 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736 1073741824" returned: 0 in 0.934s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:16 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736 Jun 19 04:16:16 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:16 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768" returned: 0 in 0.830s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Lock "cinder-quobyte-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768" released by "delete_volume" :: held 1.709s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:16 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Created reservations ['824ca7da-0da2-4366-b8ac-1d78c11627e8', '2d6d4cea-2040-44d8-8bb9-baaa1a1993b5', '565e56b3-2d6e-4ea6-b30c-f5e2ad285eca', 'fd296120-4558-4a4f-af00-c12ff63abee9'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:16 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:16:16 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:17 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736" returned: 0 in 1.548s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] <== create_volume: return (2560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:16:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.565s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1b31ac-be8d-4254-8f30-b378b836eb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e285ca97-6f24-47f5-a89f-a8a03b347736', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0996d7-0b5c-4235-a950-93eddf832071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:17 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Volume volume-e285ca97-6f24-47f5-a89f-a8a03b347736 (e285ca97-6f24-47f5-a89f-a8a03b347736): created successfully Jun 19 04:16:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0996d7-0b5c-4235-a950-93eddf832071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Flow 'volume_create_manager' (44cd00f5-685a-4eca-8ca8-38dbc6c952bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:17 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-06b65c30-e039-49ad-be10-e363f511f388 tempest-SnapshotsActionsTest-930184767 None] Created volume successfully. Jun 19 04:16:18 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.550s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:18 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:16:18 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Deleted volume successfully. Jun 19 04:16:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-057adf08-f80d-4ebd-85fe-ed825c05f33e tempest-ServerActionsTestOtherA-1972692993 None] Lock "cinder-2d8b9b75-54f7-40c0-bc71-8c3f0e57c768-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] Creating offline snapshot b8a34609-f39e-4f2b-902b-fa29b721e625 of volume e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:16:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:16:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:19 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f48f97f-bcc9-4bdb-926d-9825dfa9943d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:19 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:16:19 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:19 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736 Jun 19 04:16:19 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:20 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.065s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:16:20 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:16:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 8 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:16:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:16:20 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736" returned: 0 in 1.711s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:20 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 1G Jun 19 04:16:20 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:22 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 1G" returned: 0 in 1.460s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:22 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 Jun 19 04:16:22 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:23 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625" returned: 0 in 1.308s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:23 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 is being set with open permissions: ugo+rw Jun 19 04:16:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:23 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 Jun 19 04:16:23 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:24 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625" returned: 0 in 0.881s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:24 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.info Jun 19 04:16:24 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:25 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.info" returned: 0 in 0.704s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:25 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.info is being set with open permissions: ugo+rw Jun 19 04:16:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:25 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.info Jun 19 04:16:25 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:26 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.info" returned: 0 in 0.891s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.156s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:26 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b7e1757f-5d7e-40ec-830a-9bc250e9492e tempest-SnapshotsActionsTest-930184767 None] Create snapshot completed successfully Jun 19 04:16:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:27 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] Creating offline snapshot 06826ad0-343e-4c07-9bc8-9776d4c6284d of volume e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:16:27 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2565c608-15d6-4604-869c-e6c668bc0cc5]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:27 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 Jun 19 04:16:27 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:28 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625" returned: 0 in 0.976s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e285ca97-6f24-47f5-a89f-a8a03b347736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:16:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:28 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d 1G Jun 19 04:16:28 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:29 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d 1G" returned: 0 in 1.463s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:29 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d Jun 19 04:16:29 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:30 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d" returned: 0 in 0.957s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:30 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d is being set with open permissions: ugo+rw Jun 19 04:16:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:30 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d Jun 19 04:16:30 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:31 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d" returned: 0 in 0.957s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.487s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:31 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-9b4cea7e-65a5-4f3b-ad28-dcf564924a6b tempest-SnapshotsActionsTest-930184767 None] Create snapshot completed successfully Jun 19 04:16:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Acquiring lock "cinder-06826ad0-343e-4c07-9bc8-9776d4c6284d-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-06826ad0-343e-4c07-9bc8-9776d4c6284d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Acquiring lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Acquiring lock "cinder-quobyte-06826ad0-343e-4c07-9bc8-9776d4c6284d" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-06826ad0-343e-4c07-9bc8-9776d4c6284d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Deleting offline snapshot 06826ad0-343e-4c07-9bc8-9776d4c6284d of volume e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:16:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] snapshot_file for this snap is: volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:16:32 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cd89f0-c0f2-40c5-a906-0d7756456e90]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:32 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d Jun 19 04:16:32 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:33 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d" returned: 0 in 0.856s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e285ca97-6f24-47f5-a89f-a8a03b347736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:16:33 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7afa98-2601-4194-b7dd-40e473024aaf]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:33 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 Jun 19 04:16:33 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:34 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625" returned: 0 in 0.877s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e285ca97-6f24-47f5-a89f-a8a03b347736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:16:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:34 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d Jun 19 04:16:34 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:35 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d" returned: 0 in 0.838s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:35 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d Jun 19 04:16:35 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:36 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.06826ad0-343e-4c07-9bc8-9776d4c6284d" returned: 0 in 0.693s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-06826ad0-343e-4c07-9bc8-9776d4c6284d" released by "_delete_snapshot" :: held 3.376s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" released by "delete_snapshot" :: held 3.401s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:36 devstack cinder-volume[93300]: WARNING cinder.quota [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:16:36 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Created reservations ['d4b08e19-f985-40f9-981c-503be708cea1', '88b9650b-74aa-44e4-b55b-f8cb2f842a23', '1a29e905-ca72-4ad3-bad3-451b0be823d7', '28431c85-26df-4af4-b1d0-1d5490f82d24'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:36 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Delete snapshot completed successfully. Jun 19 04:16:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6e79f79c-ba4f-4f8b-b3c6-e99a7a30b472 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-06826ad0-343e-4c07-9bc8-9776d4c6284d-delete_snapshot" released by "delete_snapshot" :: held 3.572s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] Creating offline snapshot 9b8af48e-7d11-485d-aa7a-efc60c09f5a8 of volume e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:16:37 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09e4a44-2cc3-42c0-9de4-3315cfe08968]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:37 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 Jun 19 04:16:37 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:38 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625" returned: 0 in 1.292s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e285ca97-6f24-47f5-a89f-a8a03b347736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:16:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:38 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 1G Jun 19 04:16:38 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:39 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 1G" returned: 0 in 1.172s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:40 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 Jun 19 04:16:40 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:40 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8" returned: 0 in 0.863s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:40 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 is being set with open permissions: ugo+rw Jun 19 04:16:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:40 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 Jun 19 04:16:40 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:41 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8" returned: 0 in 0.983s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.566s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:41 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-944741a5-a664-431a-b6c8-73a0f02eda1e tempest-SnapshotsActionsTest-930184767 None] Create snapshot completed successfully Jun 19 04:16:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Acquiring lock "cinder-9b8af48e-7d11-485d-aa7a-efc60c09f5a8-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-9b8af48e-7d11-485d-aa7a-efc60c09f5a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Acquiring lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Acquiring lock "cinder-quobyte-9b8af48e-7d11-485d-aa7a-efc60c09f5a8" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-9b8af48e-7d11-485d-aa7a-efc60c09f5a8" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Deleting offline snapshot 9b8af48e-7d11-485d-aa7a-efc60c09f5a8 of volume e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:16:43 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] snapshot_file for this snap is: volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:16:43 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73ee8bb-d5a4-47f1-a1f9-dbb2ee556e53]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:43 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 Jun 19 04:16:43 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:44 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8" returned: 0 in 1.349s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e285ca97-6f24-47f5-a89f-a8a03b347736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Flow 'volume_create_manager' (fe518e17-2f52-4873-9048-973dfcc9a43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443a4dc8-b177-41e3-ae18-13b4fa980adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ee629f-53fa-422c-b224-71c15741f24c]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443a4dc8-b177-41e3-ae18-13b4fa980adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1214506423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f83865c-9ad6-4134-9234-a305430faba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8898361393604a9f9c2c58a51f3aa60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:44Z,use_quota=True,user_id='8504b3e3f72b4a028b4f82464cdddc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f133616a-bfb6-41d3-83fc-06a19fb32910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f133616a-bfb6-41d3-83fc-06a19fb32910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9679c30-7b46-4e75-8f34-a57445067826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9679c30-7b46-4e75-8f34-a57445067826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f83865c-9ad6-4134-9234-a305430faba1', 'volume_name': 'volume-7f83865c-9ad6-4134-9234-a305430faba1', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb50ca3-12b5-4b8c-8651-ba0faa273990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb50ca3-12b5-4b8c-8651-ba0faa273990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70584c55-77b2-49ed-adba-98a63a3d871c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:44 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Volume 7f83865c-9ad6-4134-9234-a305430faba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f83865c-9ad6-4134-9234-a305430faba1', 'volume_size': 1} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1214506423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f83865c-9ad6-4134-9234-a305430faba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8898361393604a9f9c2c58a51f3aa60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:44Z,use_quota=True,user_id='8504b3e3f72b4a028b4f82464cdddc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Creating volume 7f83865c-9ad6-4134-9234-a305430faba1 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:16:44 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:16:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:44 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1 1073741824 Jun 19 04:16:44 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:44 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 Jun 19 04:16:44 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:46 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1 1073741824" returned: 0 in 1.941s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:46 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625" returned: 0 in 2.039s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e285ca97-6f24-47f5-a89f-a8a03b347736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:16:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:46 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 Jun 19 04:16:46 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:46 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1 Jun 19 04:16:46 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:47 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1" returned: 0 in 1.044s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:47 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] <== create_volume: return (3097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:16:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.100s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70584c55-77b2-49ed-adba-98a63a3d871c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f83865c-9ad6-4134-9234-a305430faba1', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1cfcdf-2092-4f8e-8abd-606a95b87afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:47 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Volume volume-7f83865c-9ad6-4134-9234-a305430faba1 (7f83865c-9ad6-4134-9234-a305430faba1): created successfully Jun 19 04:16:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1cfcdf-2092-4f8e-8abd-606a95b87afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Flow 'volume_create_manager' (fe518e17-2f52-4873-9048-973dfcc9a43d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:47 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f1cac286-a97f-440a-b4ff-b0121744ebeb tempest-AttachVolumeTestJSON-1314088858 None] Created volume successfully. Jun 19 04:16:48 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8" returned: 0 in 1.710s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:48 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8 Jun 19 04:16:48 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:49 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.9b8af48e-7d11-485d-aa7a-efc60c09f5a8" returned: 0 in 0.760s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-9b8af48e-7d11-485d-aa7a-efc60c09f5a8" released by "_delete_snapshot" :: held 6.150s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" released by "delete_snapshot" :: held 6.197s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:49 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Created reservations ['bce6349b-59df-40ed-bb06-4ccb49831b1a', '0f2f1495-80e2-4b9c-936d-da1a29bcd8b8', '810ecbbf-dce5-42e4-b76b-3a7d822d49b7', '4d4d7a65-179f-4a32-856f-acd6a6eb551a'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:49 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Delete snapshot completed successfully. Jun 19 04:16:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-bb2d8ea8-0f64-4bd7-aaa7-419e86402023 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-9b8af48e-7d11-485d-aa7a-efc60c09f5a8-delete_snapshot" released by "delete_snapshot" :: held 6.345s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] Creating offline snapshot b8a2a7ea-663a-4bdd-91d9-9e1915162002 of volume e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:16:49 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[49236eca-6b85-40df-8841-086fbd164f1b]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:50 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 Jun 19 04:16:50 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:50 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625" returned: 0 in 0.948s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e285ca97-6f24-47f5-a89f-a8a03b347736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:16:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:50 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 1G Jun 19 04:16:50 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:52 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 1G" returned: 0 in 1.313s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:52 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 Jun 19 04:16:52 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-bfe26e60-f4cf-48af-bcf1-ae3e3e74b9c5 req-db73f5d0-071c-4e8e-b4d4-39aeb5fb471c tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:52 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002" returned: 0 in 0.743s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:52 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 is being set with open permissions: ugo+rw Jun 19 04:16:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:52 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 Jun 19 04:16:52 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:53 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002" returned: 0 in 0.685s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.801s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-bfe26e60-f4cf-48af-bcf1-ae3e3e74b9c5 req-db73f5d0-071c-4e8e-b4d4-39aeb5fb471c tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.353s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:53 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f42185-9774-4b9b-a623-1bf00d5cb9bc]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-bfe26e60-f4cf-48af-bcf1-ae3e3e74b9c5 req-db73f5d0-071c-4e8e-b4d4-39aeb5fb471c tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:53 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3a2c0a31-d798-4b24-96e0-a07cfda98457 tempest-SnapshotsActionsTest-930184767 None] Create snapshot completed successfully Jun 19 04:16:53 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1 Jun 19 04:16:53 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Acquiring lock "cinder-b8a2a7ea-663a-4bdd-91d9-9e1915162002-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-b8a2a7ea-663a-4bdd-91d9-9e1915162002-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Acquiring lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" acquired by "delete_snapshot" :: waited 0.048s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Acquiring lock "cinder-quobyte-b8a2a7ea-663a-4bdd-91d9-9e1915162002" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-b8a2a7ea-663a-4bdd-91d9-9e1915162002" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Deleting offline snapshot b8a2a7ea-663a-4bdd-91d9-9e1915162002 of volume e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:16:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] snapshot_file for this snap is: volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:16:54 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[34048471-082a-4590-ab09-0d1b3ea0a6fa]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:54 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 Jun 19 04:16:54 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:54 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-bfe26e60-f4cf-48af-bcf1-ae3e3e74b9c5 req-db73f5d0-071c-4e8e-b4d4-39aeb5fb471c tempest-AttachVolumeTestJSON-1314088858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1" returned: 0 in 0.833s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-bfe26e60-f4cf-48af-bcf1-ae3e3e74b9c5 req-db73f5d0-071c-4e8e-b4d4-39aeb5fb471c tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.855s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-bfe26e60-f4cf-48af-bcf1-ae3e3e74b9c5 req-db73f5d0-071c-4e8e-b4d4-39aeb5fb471c tempest-AttachVolumeTestJSON-1314088858 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-7f83865c-9ad6-4134-9234-a305430faba1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18addcca-3014-4d4b-9d56-4cd1d8c192f7', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:16:54 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-bfe26e60-f4cf-48af-bcf1-ae3e3e74b9c5 req-db73f5d0-071c-4e8e-b4d4-39aeb5fb471c tempest-AttachVolumeTestJSON-1314088858 None] attachment_update completed successfully. Jun 19 04:16:55 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002" returned: 0 in 0.787s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e285ca97-6f24-47f5-a89f-a8a03b347736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:16:55 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f245931-3a40-4dfb-9687-555a2aedd25e]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:55 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 Jun 19 04:16:55 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:56 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625" returned: 0 in 0.783s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e285ca97-6f24-47f5-a89f-a8a03b347736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:16:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:56 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 Jun 19 04:16:56 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:57 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002" returned: 0 in 1.001s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:57 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002 Jun 19 04:16:57 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:57 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a2a7ea-663a-4bdd-91d9-9e1915162002" returned: 0 in 0.932s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-b8a2a7ea-663a-4bdd-91d9-9e1915162002" released by "_delete_snapshot" :: held 3.649s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" released by "delete_snapshot" :: held 3.677s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:58 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Created reservations ['46943c03-2f2e-43d3-94b6-228ffb9d0c25', '14067ccf-0c43-43b0-8e14-a8d157d6c923', 'd1917cd7-5f44-44c3-8575-51a6a0bdeb8d', '092fb735-9dd5-412c-a4be-f4fbc98948a6'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:58 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Delete snapshot completed successfully. Jun 19 04:16:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ba1ac83-edfd-4bd0-8608-208d49f41553 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-b8a2a7ea-663a-4bdd-91d9-9e1915162002-delete_snapshot" released by "delete_snapshot" :: held 3.908s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] Creating offline snapshot 34aa0b73-8a23-4662-b3da-bd82dba79144 of volume e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:16:59 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1704145f-13c8-4c54-b132-adb6c7f22486]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:59 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 Jun 19 04:16:59 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:00 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625" returned: 0 in 1.230s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e285ca97-6f24-47f5-a89f-a8a03b347736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:17:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:00 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 1G Jun 19 04:17:00 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:02 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 1G" returned: 0 in 1.767s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:02 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 Jun 19 04:17:02 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:03 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144" returned: 0 in 0.953s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:03 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 is being set with open permissions: ugo+rw Jun 19 04:17:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:03 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 Jun 19 04:17:03 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144" returned: 0 in 0.760s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:03 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.879s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:04 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-0bd57a7f-4e20-4f86-9416-dde52bd2e989 tempest-SnapshotsActionsTest-930184767 None] Create snapshot completed successfully Jun 19 04:17:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Acquiring lock "cinder-34aa0b73-8a23-4662-b3da-bd82dba79144-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-34aa0b73-8a23-4662-b3da-bd82dba79144-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Acquiring lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Acquiring lock "cinder-quobyte-34aa0b73-8a23-4662-b3da-bd82dba79144" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-34aa0b73-8a23-4662-b3da-bd82dba79144" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Deleting offline snapshot 34aa0b73-8a23-4662-b3da-bd82dba79144 of volume e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:17:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] snapshot_file for this snap is: volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:17:04 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cc7632-59de-4814-85ea-13b150afdf32]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:04 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 Jun 19 04:17:04 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:05 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144" returned: 0 in 0.797s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e285ca97-6f24-47f5-a89f-a8a03b347736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:17:05 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c6d747-d567-4199-beb2-d32f6f29e92c]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:05 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 Jun 19 04:17:05 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:06 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625" returned: 0 in 1.324s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e285ca97-6f24-47f5-a89f-a8a03b347736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:17:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:06 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 Jun 19 04:17:06 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:08 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144" returned: 0 in 1.612s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:08 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144 Jun 19 04:17:08 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:09 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.34aa0b73-8a23-4662-b3da-bd82dba79144" returned: 0 in 1.037s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-34aa0b73-8a23-4662-b3da-bd82dba79144" released by "_delete_snapshot" :: held 4.941s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" released by "delete_snapshot" :: held 4.979s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:09 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Created reservations ['3abe30a8-6c6e-4b6b-97bd-af18ca80e0d6', 'f804097b-1aa3-466f-a1ca-22bfd16f4dd6', '33e15cf6-b006-470d-825d-828b622adff8', '7c9e5e34-868b-420e-9d61-e4272aa9e383'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:09 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Delete snapshot completed successfully. Jun 19 04:17:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ef03cb6-e56e-455c-9e38-9cf428a859d4 tempest-SnapshotsActionsTest-780196418 None] Lock "cinder-34aa0b73-8a23-4662-b3da-bd82dba79144-delete_snapshot" released by "delete_snapshot" :: held 5.325s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Acquiring lock "cinder-b8a34609-f39e-4f2b-902b-fa29b721e625-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Lock "cinder-b8a34609-f39e-4f2b-902b-fa29b721e625-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Acquiring lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" acquired by "delete_snapshot" :: waited 0.046s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Acquiring lock "cinder-quobyte-b8a34609-f39e-4f2b-902b-fa29b721e625" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Lock "cinder-quobyte-b8a34609-f39e-4f2b-902b-fa29b721e625" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Deleting offline snapshot b8a34609-f39e-4f2b-902b-fa29b721e625 of volume e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:17:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] snapshot_file for this snap is: volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:17:11 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c741b3-2271-4bfe-8fd9-17fef289f92a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:11 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 Jun 19 04:17:11 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:12 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625" returned: 0 in 1.628s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e285ca97-6f24-47f5-a89f-a8a03b347736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:17:12 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7dfa7b-abfc-47c2-b3ac-26d3ed205ccf]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:13 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736 Jun 19 04:17:13 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:14 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=51,cinder:UPDATE=49,cinder:INSERT=11,cinder:DELETE=5 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:17:14 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=53,cinder:UPDATE=41,cinder:INSERT=12,cinder:DELETE=3 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:17:14 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-76731533-fd0e-46a6-a741-b341dd71bea9 req-2d892107-92fd-4852-8424-3c7f81ac0aef tempest-AttachVolumeNegativeTest-1515607248 None] Terminate volume connection completed successfully. Jun 19 04:17:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-76731533-fd0e-46a6-a741-b341dd71bea9 req-2d892107-92fd-4852-8424-3c7f81ac0aef tempest-AttachVolumeNegativeTest-1515607248 None] Deleting attachment 34e8ea79-512e-49d5-9bdc-5f1817574ee9. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:17:14 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736" returned: 0 in 1.579s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:14 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 Jun 19 04:17:14 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:15 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625" returned: 0 in 1.063s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:15 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625 Jun 19 04:17:15 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:16 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736.b8a34609-f39e-4f2b-902b-fa29b721e625" returned: 0 in 1.373s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Lock "cinder-quobyte-b8a34609-f39e-4f2b-902b-fa29b721e625" released by "_delete_snapshot" :: held 5.804s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" released by "delete_snapshot" :: held 5.846s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:17 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Created reservations ['2dddd027-7bd7-4d8c-8c01-91cadcb78fac', 'aa449870-66ce-40ab-8742-002c1e7b9576', '02881191-a5e7-4ece-b1a7-9ac17c67c328', 'e70629d2-4bc8-4101-b206-b5eae5f7f5e4'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:17 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Delete snapshot completed successfully. Jun 19 04:17:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3975af66-fbbe-4f5e-a0c0-6c8ef2106e99 tempest-SnapshotsActionsTest-930184767 None] Lock "cinder-b8a34609-f39e-4f2b-902b-fa29b721e625-delete_snapshot" released by "delete_snapshot" :: held 6.084s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Acquiring lock "cinder-e285ca97-6f24-47f5-a89f-a8a03b347736-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Lock "cinder-e285ca97-6f24-47f5-a89f-a8a03b347736-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Acquiring lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" acquired by "delete_volume" :: waited 0.026s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:18 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc635cd1-f5da-4373-a998-f88ac322d460]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:18 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736 Jun 19 04:17:18 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:19 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736" returned: 0 in 1.126s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:19 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736 Jun 19 04:17:19 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:17:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:19 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:17:19 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:20 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.056s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 8 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:17:20 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e285ca97-6f24-47f5-a89f-a8a03b347736" returned: 0 in 1.271s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Lock "cinder-quobyte-e285ca97-6f24-47f5-a89f-a8a03b347736" released by "delete_volume" :: held 2.481s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Created reservations ['45fb1776-a369-4149-912c-999bfd5d4d20', '1574a44f-9ea7-46b1-896e-30b60e6f0f99', '32df651e-f682-4af0-99eb-845c4934a008', '6ca0833c-47f2-4b78-8e8c-3d1ead3370bf'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:20 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:17:20 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:21 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.666s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:21 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:21 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Deleted volume successfully. Jun 19 04:17:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-aae85ad1-7919-4629-b5a8-1f9536f93ab8 tempest-SnapshotsActionsTest-930184767 None] Lock "cinder-e285ca97-6f24-47f5-a89f-a8a03b347736-delete_volume" released by "delete_volume" :: held 3.457s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:25 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Flow 'volume_create_manager' (96140c26-6465-4182-b2cd-13dfe4af9429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62132845-13b7-4dc1-a3d9-1069a74a4a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62132845-13b7-4dc1-a3d9-1069a74a4a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1319201148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e81068-4e23-48d9-b0d7-7fce7abe7738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302c9f3a46e24e279f0e3e2e14613c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:26Z,use_quota=True,user_id='eaf1fb4ed780429b8b522ac68b27da54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c9618c-576e-4a1b-9f40-dd4c78e63f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c9618c-576e-4a1b-9f40-dd4c78e63f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a08b1b-ab47-4448-8db6-9718e133c840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a08b1b-ab47-4448-8db6-9718e133c840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e81068-4e23-48d9-b0d7-7fce7abe7738', 'volume_name': 'volume-21e81068-4e23-48d9-b0d7-7fce7abe7738', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14884c57-6d14-4f42-a40f-ac928794e2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14884c57-6d14-4f42-a40f-ac928794e2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381b671a-d300-4a78-b3ad-bd4336437126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:25 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Volume 21e81068-4e23-48d9-b0d7-7fce7abe7738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e81068-4e23-48d9-b0d7-7fce7abe7738', 'volume_size': 1} Jun 19 04:17:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1319201148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e81068-4e23-48d9-b0d7-7fce7abe7738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302c9f3a46e24e279f0e3e2e14613c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:26Z,use_quota=True,user_id='eaf1fb4ed780429b8b522ac68b27da54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Creating volume 21e81068-4e23-48d9-b0d7-7fce7abe7738 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:26 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:17:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-21e81068-4e23-48d9-b0d7-7fce7abe7738 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:26 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-21e81068-4e23-48d9-b0d7-7fce7abe7738 1073741824 Jun 19 04:17:26 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:27 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-21e81068-4e23-48d9-b0d7-7fce7abe7738 1073741824" returned: 0 in 1.224s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-21e81068-4e23-48d9-b0d7-7fce7abe7738 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:27 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-21e81068-4e23-48d9-b0d7-7fce7abe7738 Jun 19 04:17:27 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:28 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-21e81068-4e23-48d9-b0d7-7fce7abe7738" returned: 0 in 1.005s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] <== create_volume: return (2293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.296s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381b671a-d300-4a78-b3ad-bd4336437126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e81068-4e23-48d9-b0d7-7fce7abe7738', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7918d4d9-8e71-4fc7-8fae-01380da20037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:28 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Volume volume-21e81068-4e23-48d9-b0d7-7fce7abe7738 (21e81068-4e23-48d9-b0d7-7fce7abe7738): created successfully Jun 19 04:17:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7918d4d9-8e71-4fc7-8fae-01380da20037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Flow 'volume_create_manager' (96140c26-6465-4182-b2cd-13dfe4af9429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:28 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e51cbd6e-086c-4d1f-b768-822a919d5873 tempest-ServerRescueNegativeTestJSON-1929120346 None] Created volume successfully. Jun 19 04:17:38 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:17:38 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:17:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Acquiring lock "cinder-21e81068-4e23-48d9-b0d7-7fce7abe7738-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Lock "cinder-21e81068-4e23-48d9-b0d7-7fce7abe7738-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Acquiring lock "cinder-quobyte-21e81068-4e23-48d9-b0d7-7fce7abe7738" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Lock "cinder-quobyte-21e81068-4e23-48d9-b0d7-7fce7abe7738" acquired by "delete_volume" :: waited 0.021s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:54 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a34dd1-9216-4e40-9656-7ee7e1beb64a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-21e81068-4e23-48d9-b0d7-7fce7abe7738 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:54 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-21e81068-4e23-48d9-b0d7-7fce7abe7738 Jun 19 04:17:54 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:55 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-21e81068-4e23-48d9-b0d7-7fce7abe7738" returned: 0 in 0.863s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-21e81068-4e23-48d9-b0d7-7fce7abe7738 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:55 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-21e81068-4e23-48d9-b0d7-7fce7abe7738 Jun 19 04:17:55 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:56 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-21e81068-4e23-48d9-b0d7-7fce7abe7738" returned: 0 in 0.877s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Lock "cinder-quobyte-21e81068-4e23-48d9-b0d7-7fce7abe7738" released by "delete_volume" :: held 1.816s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:56 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Created reservations ['30d35639-3b26-4666-973e-619a29ef43da', 'cf7c74fa-69d1-48cb-bf2c-118a54c90778', '30317b45-af6c-402d-9c95-0898eb8f0598', '64563b21-5f90-4efd-96a8-ccbbd9f81b66'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:56 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:17:56 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:57 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.054s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:57 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:57 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Deleted volume successfully. Jun 19 04:17:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-98ced9a0-3c47-4bcc-ad85-996accf491bc tempest-ServerRescueNegativeTestJSON-1929120346 None] Lock "cinder-21e81068-4e23-48d9-b0d7-7fce7abe7738-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:06 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=10 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:18:07 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=6,cinder:SELECT=2,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:18:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:18:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:19 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:18:19 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:20 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.541s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:20 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:18:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 8 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:18:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Flow 'volume_create_manager' (eebef247-503e-4610-9fa4-2cdfee40f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ef82c0-16af-4e11-b85e-602720975de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ef82c0-16af-4e11-b85e-602720975de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1222157556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b3ff59-d1ab-44c9-8398-c83238754fd8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41807b2980e444cc8eb54b9bd5331f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:24Z,use_quota=True,user_id='d71e6b02513241c8840e7127aa30d309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5db9ccb-d816-48ed-a29b-e735f9d7bdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5db9ccb-d816-48ed-a29b-e735f9d7bdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b3db87-6d55-402c-97bb-3c9eb8b9b53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b3db87-6d55-402c-97bb-3c9eb8b9b53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b3ff59-d1ab-44c9-8398-c83238754fd8', 'volume_name': 'volume-41b3ff59-d1ab-44c9-8398-c83238754fd8', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0190d3-ac92-48c1-825e-2e191973c5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0190d3-ac92-48c1-825e-2e191973c5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71278f4f-ee76-4fd0-bd77-b3dada355871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:23 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Volume 41b3ff59-d1ab-44c9-8398-c83238754fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b3ff59-d1ab-44c9-8398-c83238754fd8', 'volume_size': 1} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1222157556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b3ff59-d1ab-44c9-8398-c83238754fd8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41807b2980e444cc8eb54b9bd5331f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:24Z,use_quota=True,user_id='d71e6b02513241c8840e7127aa30d309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Creating volume 41b3ff59-d1ab-44c9-8398-c83238754fd8 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:23 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:18:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-41b3ff59-d1ab-44c9-8398-c83238754fd8 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:24 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-41b3ff59-d1ab-44c9-8398-c83238754fd8 1073741824 Jun 19 04:18:24 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Flow 'volume_create_manager' (7134ac99-63a6-4043-8a89-642bb7b7e325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185c7b6c-7b5e-48b3-895b-1b5cac49fd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185c7b6c-7b5e-48b3-895b-1b5cac49fd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-366768875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abcb3a4bdbb41ff9f16dffaa89a212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:24Z,use_quota=True,user_id='139cdf5ed90147d69b755b9d117c66da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c09434c-ba36-46ea-a1a3-683f14d28550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c09434c-ba36-46ea-a1a3-683f14d28550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddfdc4b-1c55-4886-bc96-ef14e1ac8f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddfdc4b-1c55-4886-bc96-ef14e1ac8f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894', 'volume_name': 'volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11110f69-d5b2-413f-b94d-cac50dbaf753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11110f69-d5b2-413f-b94d-cac50dbaf753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b9b34a-2cbb-4585-8bea-14bc70fd0e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:24 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Volume 9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894', 'volume_size': 1} Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:24 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-41b3ff59-d1ab-44c9-8398-c83238754fd8 1073741824" returned: 0 in 0.879s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-41b3ff59-d1ab-44c9-8398-c83238754fd8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:24 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-41b3ff59-d1ab-44c9-8398-c83238754fd8 Jun 19 04:18:24 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:25 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-41b3ff59-d1ab-44c9-8398-c83238754fd8" returned: 0 in 0.626s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-366768875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abcb3a4bdbb41ff9f16dffaa89a212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:24Z,use_quota=True,user_id='139cdf5ed90147d69b755b9d117c66da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Creating volume 9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:25 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:25 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894 1073741824 Jun 19 04:18:25 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71278f4f-ee76-4fd0-bd77-b3dada355871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b3ff59-d1ab-44c9-8398-c83238754fd8', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5715dd-82af-455d-bb71-59d99aba80b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:25 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Volume volume-41b3ff59-d1ab-44c9-8398-c83238754fd8 (41b3ff59-d1ab-44c9-8398-c83238754fd8): created successfully Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5715dd-82af-455d-bb71-59d99aba80b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Flow 'volume_create_manager' (eebef247-503e-4610-9fa4-2cdfee40f203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:25 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-71c9369f-f1ec-4f13-a99a-91112df4b47f req-0904a99f-4929-4fcb-82ae-e0bb4ed16911 tempest-VolumesGetTestJSON-98749693 None] Created volume successfully. Jun 19 04:18:26 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Acquiring lock "cinder-41b3ff59-d1ab-44c9-8398-c83238754fd8-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:26 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Lock "cinder-41b3ff59-d1ab-44c9-8398-c83238754fd8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:26 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Acquiring lock "cinder-quobyte-41b3ff59-d1ab-44c9-8398-c83238754fd8" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:26 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Lock "cinder-quobyte-41b3ff59-d1ab-44c9-8398-c83238754fd8" acquired by "delete_volume" :: waited 0.031s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:26 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cae99d5-89db-406e-a222-789c3251daf5]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-41b3ff59-d1ab-44c9-8398-c83238754fd8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:26 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894 1073741824" returned: 0 in 0.981s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:26 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894 Jun 19 04:18:26 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:26 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-41b3ff59-d1ab-44c9-8398-c83238754fd8 Jun 19 04:18:26 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:27 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894" returned: 0 in 0.731s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b9b34a-2cbb-4585-8bea-14bc70fd0e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b190fb-5839-4bdc-98ab-5c7786810237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Volume volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894 (9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894): created successfully Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b190fb-5839-4bdc-98ab-5c7786810237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Flow 'volume_create_manager' (7134ac99-63a6-4043-8a89-642bb7b7e325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:27 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-38687c65-bf93-478b-89d4-ff041605e2cf tempest-VolumesActionsTest-2084830866 None] Created volume successfully. Jun 19 04:18:27 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-41b3ff59-d1ab-44c9-8398-c83238754fd8" returned: 0 in 1.121s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-41b3ff59-d1ab-44c9-8398-c83238754fd8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:27 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-41b3ff59-d1ab-44c9-8398-c83238754fd8 Jun 19 04:18:27 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Flow 'volume_create_manager' (6cfb0383-3ff3-49b5-89bc-711b1c1540ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf95a73a-0e18-466e-9ee3-eb22bfb28c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf95a73a-0e18-466e-9ee3-eb22bfb28c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-601124895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84df69ee-2106-47ac-ac68-9ea91ff163d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d0e6c92a4540f79531cbf8275f6683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:28Z,use_quota=True,user_id='41e97d44b6a946709ef0296861669188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985abe0c-b765-40d7-826c-22ce48cd9fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985abe0c-b765-40d7-826c-22ce48cd9fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7031c2ea-21bf-4754-b75d-1a1b05b72b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7031c2ea-21bf-4754-b75d-1a1b05b72b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84df69ee-2106-47ac-ac68-9ea91ff163d0', 'volume_name': 'volume-84df69ee-2106-47ac-ac68-9ea91ff163d0', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329c8806-fc64-47da-beb0-d3d239c241b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329c8806-fc64-47da-beb0-d3d239c241b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559aa546-5154-4efa-b042-0a51bb88ed17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Volume 84df69ee-2106-47ac-ac68-9ea91ff163d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84df69ee-2106-47ac-ac68-9ea91ff163d0', 'volume_size': 1} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-601124895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84df69ee-2106-47ac-ac68-9ea91ff163d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d0e6c92a4540f79531cbf8275f6683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:28Z,use_quota=True,user_id='41e97d44b6a946709ef0296861669188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Creating volume 84df69ee-2106-47ac-ac68-9ea91ff163d0 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:27 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:18:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:27 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0 1073741824 Jun 19 04:18:27 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:28 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-41b3ff59-d1ab-44c9-8398-c83238754fd8" returned: 0 in 0.685s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Lock "cinder-quobyte-41b3ff59-d1ab-44c9-8398-c83238754fd8" released by "delete_volume" :: held 1.865s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG cinder.quota [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Created reservations ['13708dbc-547a-4ec8-8ba3-efa564b69e3d', 'b14be721-1708-4935-ba27-7e64bff04d84', '35e41b1f-bb54-4755-8f0f-995c163a326d', '63e1fec9-9c73-4063-8112-18b80254d980'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:28 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:18:28 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-38194dc8-cf63-4d20-993c-73f194efcc35 tempest-VolumesActionsTest-2084830866 None] Acquiring lock "cinder-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894" by "attach_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-38194dc8-cf63-4d20-993c-73f194efcc35 tempest-VolumesActionsTest-2084830866 None] Lock "cinder-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894" acquired by "attach_volume" :: waited 0.037s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:28 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-38194dc8-cf63-4d20-993c-73f194efcc35 tempest-VolumesActionsTest-2084830866 None] Attaching volume 9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894 to instance e32c479d-f0f0-4835-adb3-42f3c6d0eb12 at mountpoint /dev/vdb on host None. Jun 19 04:18:28 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-38194dc8-cf63-4d20-993c-73f194efcc35 tempest-VolumesActionsTest-2084830866 None] Attach volume completed successfully. Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-38194dc8-cf63-4d20-993c-73f194efcc35 tempest-VolumesActionsTest-2084830866 None] Lock "cinder-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894" released by "attach_volume" :: held 0.125s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:28 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0 1073741824" returned: 0 in 1.114s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:29 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0 Jun 19 04:18:29 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:29 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.176s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:29 devstack cinder-volume[93300]: DEBUG cinder.manager [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:29 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Deleted volume successfully. Jun 19 04:18:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-7e34d350-54cd-480a-a1f6-16bed602b0e2 req-1b7852a3-73b5-4b0d-8278-0775a70575b7 tempest-VolumesGetTestJSON-98749693 None] Lock "cinder-41b3ff59-d1ab-44c9-8398-c83238754fd8-delete_volume" released by "delete_volume" :: held 3.379s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:30 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0" returned: 0 in 1.167s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] <== create_volume: return (2355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.361s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559aa546-5154-4efa-b042-0a51bb88ed17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84df69ee-2106-47ac-ac68-9ea91ff163d0', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14801344-f2a6-403e-b106-bc33626d7a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:30 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Volume volume-84df69ee-2106-47ac-ac68-9ea91ff163d0 (84df69ee-2106-47ac-ac68-9ea91ff163d0): created successfully Jun 19 04:18:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14801344-f2a6-403e-b106-bc33626d7a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Flow 'volume_create_manager' (6cfb0383-3ff3-49b5-89bc-711b1c1540ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:30 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b4243a71-5b0f-4f59-8739-7304598ac703 tempest-VolumesActionsTest-1702494765 None] Terminate volume connection completed successfully. Jun 19 04:18:30 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-bb7666a1-4516-4e39-a610-31b6f92084cd tempest-AttachVolumeNegativeTest-1515607248 None] Created volume successfully. Jun 19 04:18:30 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b4243a71-5b0f-4f59-8739-7304598ac703 tempest-VolumesActionsTest-1702494765 None] Acquiring lock "cinder-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894-detach_volume" by "detach_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:30 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b4243a71-5b0f-4f59-8739-7304598ac703 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:30 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b4243a71-5b0f-4f59-8739-7304598ac703 tempest-VolumesActionsTest-1702494765 None] Detaching volume 9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894 from instance e32c479d-f0f0-4835-adb3-42f3c6d0eb12. Jun 19 04:18:30 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b4243a71-5b0f-4f59-8739-7304598ac703 tempest-VolumesActionsTest-1702494765 None] Detach volume completed successfully. Jun 19 04:18:30 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b4243a71-5b0f-4f59-8739-7304598ac703 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894-detach_volume" released by "detach_volume" :: held 0.143s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9be82bab-99f6-4147-9239-d9cb7d8d310e tempest-VolumesActionsTest-2084830866 None] Acquiring lock "cinder-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894-detach_volume" by "detach_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9be82bab-99f6-4147-9239-d9cb7d8d310e tempest-VolumesActionsTest-2084830866 None] Lock "cinder-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:31 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-9be82bab-99f6-4147-9239-d9cb7d8d310e tempest-VolumesActionsTest-2084830866 None] Volume detach called, but volume not attached. Jun 19 04:18:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9be82bab-99f6-4147-9239-d9cb7d8d310e tempest-VolumesActionsTest-2084830866 None] Lock "cinder-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894-detach_volume" released by "detach_volume" :: held 0.015s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Acquiring lock "cinder-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Lock "cinder-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Acquiring lock "cinder-quobyte-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Lock "cinder-quobyte-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894" acquired by "delete_volume" :: waited 0.029s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:32 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a12b822-821f-43cf-b5a1-ddb50e1e1e48]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:32 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894 Jun 19 04:18:32 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:33 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894" returned: 0 in 0.903s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:33 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894 Jun 19 04:18:33 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Flow 'volume_create_manager' (144966bf-ba5b-4e8a-931c-9cf79537490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b767dc0c-44fc-40e8-a902-f95e17e12c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b767dc0c-44fc-40e8-a902-f95e17e12c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1069018698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e39b6c-2c6e-428f-881c-a9fa4e643c63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdb89dd3ecee4f9ca718f71a6ab9d7cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:34Z,use_quota=True,user_id='24fad296332347248b628bd633884ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e74b95-b4bc-43a3-b092-93926e3bcf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e74b95-b4bc-43a3-b092-93926e3bcf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c792a05-b7b5-4aad-9d28-0809d8cdc1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c792a05-b7b5-4aad-9d28-0809d8cdc1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e39b6c-2c6e-428f-881c-a9fa4e643c63', 'volume_name': 'volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccf321b-0689-4b83-9574-1cd4ac8a9cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccf321b-0689-4b83-9574-1cd4ac8a9cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e959d5-5971-4fdc-9db5-8eb08c5e4b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:33 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Volume 24e39b6c-2c6e-428f-881c-a9fa4e643c63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63', 'volume_size': 1} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1069018698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e39b6c-2c6e-428f-881c-a9fa4e643c63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdb89dd3ecee4f9ca718f71a6ab9d7cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:34Z,use_quota=True,user_id='24fad296332347248b628bd633884ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Creating volume 24e39b6c-2c6e-428f-881c-a9fa4e643c63 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:33 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:18:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:33 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63 1073741824 Jun 19 04:18:33 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-bf46f81b-6c50-46fd-99fa-4ba51e94cc04 req-d85b2785-8d0a-41f5-b244-56af7df03fa0 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:34 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894" returned: 0 in 0.958s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:34 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Lock "cinder-quobyte-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894" released by "delete_volume" :: held 1.911s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:34 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Created reservations ['e02e7b09-ddf9-4df6-bb0d-7f57725c6733', 'eae0789b-6c7c-4f81-876b-cf9f1d7bf7a9', 'fa239681-9153-454e-b496-ba811f37acb3', '15dd90dc-17a9-4679-a85b-3eb3c6f46113'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:34 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:18:34 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:34 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63 1073741824" returned: 0 in 1.005s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:34 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63 Jun 19 04:18:34 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:35 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.789s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:35 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:35 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Deleted volume successfully. Jun 19 04:18:35 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1ebdf10b-3489-49a1-ae4c-4095ea774eb7 tempest-VolumesActionsTest-2084830866 None] Lock "cinder-9dab6ef1-cb1a-42fb-8da6-9d4e7c1e7894-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:35 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63" returned: 0 in 0.817s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-bf46f81b-6c50-46fd-99fa-4ba51e94cc04 req-d85b2785-8d0a-41f5-b244-56af7df03fa0 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.717s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e959d5-5971-4fdc-9db5-8eb08c5e4b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece8ebe4-de7a-40d1-bc5f-190f5a6d65c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:35 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0852eb20-6d97-46f0-9fb0-16a5ee87a4d6]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-bf46f81b-6c50-46fd-99fa-4ba51e94cc04 req-d85b2785-8d0a-41f5-b244-56af7df03fa0 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:35 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Volume volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63 (24e39b6c-2c6e-428f-881c-a9fa4e643c63): created successfully Jun 19 04:18:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece8ebe4-de7a-40d1-bc5f-190f5a6d65c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Flow 'volume_create_manager' (144966bf-ba5b-4e8a-931c-9cf79537490e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:35 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-20da1f7b-c3a5-43db-95e7-ed17a1c2a7cd tempest-VolumesTestJSON-955891896 None] Created volume successfully. Jun 19 04:18:35 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0 Jun 19 04:18:35 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:36 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-bf46f81b-6c50-46fd-99fa-4ba51e94cc04 req-d85b2785-8d0a-41f5-b244-56af7df03fa0 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0" returned: 0 in 0.915s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-bf46f81b-6c50-46fd-99fa-4ba51e94cc04 req-d85b2785-8d0a-41f5-b244-56af7df03fa0 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.956s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-bf46f81b-6c50-46fd-99fa-4ba51e94cc04 req-d85b2785-8d0a-41f5-b244-56af7df03fa0 tempest-AttachVolumeNegativeTest-1515607248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-84df69ee-2106-47ac-ac68-9ea91ff163d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '212dad18-2bef-4f53-9ce6-54d9b1b725df', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:18:36 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-bf46f81b-6c50-46fd-99fa-4ba51e94cc04 req-d85b2785-8d0a-41f5-b244-56af7df03fa0 tempest-AttachVolumeNegativeTest-1515607248 None] attachment_update completed successfully. Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Flow 'volume_create_manager' (5e1b5c20-f22e-4487-b428-991222e71b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b978524-7fa9-4fd6-a7d2-a042de144b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b978524-7fa9-4fd6-a7d2-a042de144b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-406525665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6915cc4c-42ac-48f1-b331-387202d21734,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdb89dd3ecee4f9ca718f71a6ab9d7cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:38Z,use_quota=True,user_id='24fad296332347248b628bd633884ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31057242-b956-4a74-9f1b-8a4c9b553d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31057242-b956-4a74-9f1b-8a4c9b553d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b7e766-aaef-45a6-8e9d-ed275024f572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b7e766-aaef-45a6-8e9d-ed275024f572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6915cc4c-42ac-48f1-b331-387202d21734', 'volume_name': 'volume-6915cc4c-42ac-48f1-b331-387202d21734', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5bdf71-094e-4ec7-85a9-090c778d6bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5bdf71-094e-4ec7-85a9-090c778d6bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84056d7-7e9a-4378-83dc-ef5a3a202069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:37 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Volume 6915cc4c-42ac-48f1-b331-387202d21734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6915cc4c-42ac-48f1-b331-387202d21734', 'volume_size': 1} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-406525665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6915cc4c-42ac-48f1-b331-387202d21734,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdb89dd3ecee4f9ca718f71a6ab9d7cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:38Z,use_quota=True,user_id='24fad296332347248b628bd633884ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Creating volume 6915cc4c-42ac-48f1-b331-387202d21734 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:37 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:18:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6915cc4c-42ac-48f1-b331-387202d21734 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:37 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6915cc4c-42ac-48f1-b331-387202d21734 1073741824 Jun 19 04:18:37 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:38 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6915cc4c-42ac-48f1-b331-387202d21734 1073741824" returned: 0 in 0.996s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6915cc4c-42ac-48f1-b331-387202d21734 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:38 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6915cc4c-42ac-48f1-b331-387202d21734 Jun 19 04:18:38 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:39 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6915cc4c-42ac-48f1-b331-387202d21734" returned: 0 in 0.716s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84056d7-7e9a-4378-83dc-ef5a3a202069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6915cc4c-42ac-48f1-b331-387202d21734', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc45579-44d1-439c-8b9d-4d638270cb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:39 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Volume volume-6915cc4c-42ac-48f1-b331-387202d21734 (6915cc4c-42ac-48f1-b331-387202d21734): created successfully Jun 19 04:18:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc45579-44d1-439c-8b9d-4d638270cb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Flow 'volume_create_manager' (5e1b5c20-f22e-4487-b428-991222e71b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:39 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-cd19eacd-5603-4a0f-beb5-c800b4cfc16a tempest-VolumesTestJSON-955891896 None] Created volume successfully. Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Flow 'volume_create_manager' (427a8a63-0383-44c2-922e-1bc1e41ae89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932eaccb-be7b-44e2-bfd8-169088d8628e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932eaccb-be7b-44e2-bfd8-169088d8628e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2056071568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be47766-6218-40c6-a726-ea4c1327eb8e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdb89dd3ecee4f9ca718f71a6ab9d7cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:40Z,use_quota=True,user_id='24fad296332347248b628bd633884ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fec9561-80d6-4cbb-baec-236bcdba067e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fec9561-80d6-4cbb-baec-236bcdba067e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15203db9-0eff-4cd6-9b6a-36fa32fa195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15203db9-0eff-4cd6-9b6a-36fa32fa195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0be47766-6218-40c6-a726-ea4c1327eb8e', 'volume_name': 'volume-0be47766-6218-40c6-a726-ea4c1327eb8e', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f41e7a2-f5cc-400f-916c-02fe0ddaaeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f41e7a2-f5cc-400f-916c-02fe0ddaaeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1428ae-6f1b-4744-a351-f13f84d4f491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:40 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Volume 0be47766-6218-40c6-a726-ea4c1327eb8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0be47766-6218-40c6-a726-ea4c1327eb8e', 'volume_size': 1} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2056071568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be47766-6218-40c6-a726-ea4c1327eb8e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdb89dd3ecee4f9ca718f71a6ab9d7cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:40Z,use_quota=True,user_id='24fad296332347248b628bd633884ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Creating volume 0be47766-6218-40c6-a726-ea4c1327eb8e {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:40 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:18:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0be47766-6218-40c6-a726-ea4c1327eb8e 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:40 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0be47766-6218-40c6-a726-ea4c1327eb8e 1073741824 Jun 19 04:18:40 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:41 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0be47766-6218-40c6-a726-ea4c1327eb8e 1073741824" returned: 0 in 0.834s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0be47766-6218-40c6-a726-ea4c1327eb8e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:41 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0be47766-6218-40c6-a726-ea4c1327eb8e Jun 19 04:18:41 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:41 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0be47766-6218-40c6-a726-ea4c1327eb8e" returned: 0 in 0.802s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1428ae-6f1b-4744-a351-f13f84d4f491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be47766-6218-40c6-a726-ea4c1327eb8e', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d741712-87be-46dc-8eee-b25328361bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:41 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Volume volume-0be47766-6218-40c6-a726-ea4c1327eb8e (0be47766-6218-40c6-a726-ea4c1327eb8e): created successfully Jun 19 04:18:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d741712-87be-46dc-8eee-b25328361bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Flow 'volume_create_manager' (427a8a63-0383-44c2-922e-1bc1e41ae89c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:42 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ad379b83-1b45-44f6-addf-3fc34a243f1a tempest-VolumesTestJSON-955891896 None] Created volume successfully. Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Flow 'volume_create_manager' (c0a30baf-1f90-46e9-afcc-32471b68a91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af28d4e-2337-45b4-a0b4-e320399d3cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af28d4e-2337-45b4-a0b4-e320399d3cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-70178376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18bc8bff-87a3-4d39-95e0-c0c28cc6dd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abcb3a4bdbb41ff9f16dffaa89a212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:43Z,use_quota=True,user_id='139cdf5ed90147d69b755b9d117c66da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f31863-12a5-4b45-92d7-7be167f6efb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f31863-12a5-4b45-92d7-7be167f6efb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2423936b-6a50-4ad2-a99a-24546468eab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2423936b-6a50-4ad2-a99a-24546468eab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18bc8bff-87a3-4d39-95e0-c0c28cc6dd85', 'volume_name': 'volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e657424-494f-4332-92f3-2936570e8678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e657424-494f-4332-92f3-2936570e8678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f60cbf-c0b6-4430-81cc-34ab982c7545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:42 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Volume 18bc8bff-87a3-4d39-95e0-c0c28cc6dd85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85', 'volume_size': 1} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-70178376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18bc8bff-87a3-4d39-95e0-c0c28cc6dd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abcb3a4bdbb41ff9f16dffaa89a212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:43Z,use_quota=True,user_id='139cdf5ed90147d69b755b9d117c66da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Creating volume 18bc8bff-87a3-4d39-95e0-c0c28cc6dd85 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:42 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:18:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:42 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85 1073741824 Jun 19 04:18:42 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Acquiring lock "cinder-0be47766-6218-40c6-a726-ea4c1327eb8e-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Lock "cinder-0be47766-6218-40c6-a726-ea4c1327eb8e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Acquiring lock "cinder-quobyte-0be47766-6218-40c6-a726-ea4c1327eb8e" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Lock "cinder-quobyte-0be47766-6218-40c6-a726-ea4c1327eb8e" acquired by "delete_volume" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:43 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7336305-bca0-46b4-8751-1a77c3bc8757]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0be47766-6218-40c6-a726-ea4c1327eb8e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:43 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-c47af2ee-5373-47f6-9b63-6f3ed07221be req-f7fa3dc6-6f72-4cb2-b861-78dbe576d5a1 tempest-AttachVolumeNegativeTest-1515607248 None] Terminate volume connection completed successfully. Jun 19 04:18:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-c47af2ee-5373-47f6-9b63-6f3ed07221be req-f7fa3dc6-6f72-4cb2-b861-78dbe576d5a1 tempest-AttachVolumeNegativeTest-1515607248 None] Deleting attachment 212dad18-2bef-4f53-9ce6-54d9b1b725df. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:18:43 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0be47766-6218-40c6-a726-ea4c1327eb8e Jun 19 04:18:43 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:43 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85 1073741824" returned: 0 in 0.880s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:43 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85 Jun 19 04:18:43 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:44 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0be47766-6218-40c6-a726-ea4c1327eb8e" returned: 0 in 0.877s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0be47766-6218-40c6-a726-ea4c1327eb8e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:44 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0be47766-6218-40c6-a726-ea4c1327eb8e Jun 19 04:18:44 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:44 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85" returned: 0 in 0.749s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f60cbf-c0b6-4430-81cc-34ab982c7545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc99689-cf81-4f8d-8955-cbd3965f7a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:44 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Volume volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85 (18bc8bff-87a3-4d39-95e0-c0c28cc6dd85): created successfully Jun 19 04:18:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc99689-cf81-4f8d-8955-cbd3965f7a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Flow 'volume_create_manager' (c0a30baf-1f90-46e9-afcc-32471b68a91c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:44 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-65ccf048-a1ab-486e-9315-23f931e0a71b tempest-VolumesActionsTest-2084830866 None] Created volume successfully. Jun 19 04:18:44 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0be47766-6218-40c6-a726-ea4c1327eb8e" returned: 0 in 0.685s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:44 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Lock "cinder-quobyte-0be47766-6218-40c6-a726-ea4c1327eb8e" released by "delete_volume" :: held 1.630s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:44 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Acquiring lock "cinder-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:44 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Created reservations ['4f514d28-fc31-4744-88e3-19a9bae81493', '3cf20c55-18c1-4262-a059-285bb9b42d3c', '1cef6908-c6c2-4a63-8a04-cbc87a01fc07', '50532eb8-6a62-442d-8523-01732bb1f805'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Acquiring lock "cinder-quobyte-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-quobyte-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85" acquired by "delete_volume" :: waited 0.024s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb07620c-c089-4efa-bc22-ae96ac5b0db7]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:45 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:18:45 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:45 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85 Jun 19 04:18:45 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Acquiring lock "cinder-6915cc4c-42ac-48f1-b331-387202d21734-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Lock "cinder-6915cc4c-42ac-48f1-b331-387202d21734-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Acquiring lock "cinder-quobyte-6915cc4c-42ac-48f1-b331-387202d21734" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Lock "cinder-quobyte-6915cc4c-42ac-48f1-b331-387202d21734" acquired by "delete_volume" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7690e85c-bbe6-448f-bd5f-7e3fa071dc1f]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6915cc4c-42ac-48f1-b331-387202d21734 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:45 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6915cc4c-42ac-48f1-b331-387202d21734 Jun 19 04:18:45 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:45 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.805s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:45 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Deleted volume successfully. Jun 19 04:18:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-719d12f2-2464-43f5-86c5-485def016e95 tempest-VolumesTestJSON-955891896 None] Lock "cinder-0be47766-6218-40c6-a726-ea4c1327eb8e-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:46 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85" returned: 0 in 0.933s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:46 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85 Jun 19 04:18:46 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:46 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6915cc4c-42ac-48f1-b331-387202d21734" returned: 0 in 1.097s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6915cc4c-42ac-48f1-b331-387202d21734 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85" returned: 0 in 0.836s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:46 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:46 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6915cc4c-42ac-48f1-b331-387202d21734 Jun 19 04:18:46 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-quobyte-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85" released by "delete_volume" :: held 1.820s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:46 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Created reservations ['7e5054cd-8982-488d-8c6b-af29b5840821', '0fa24733-232c-4d26-9744-d933fb61da2b', '6d32200b-7884-49d9-be6a-62df18eda005', '11a3c641-0069-405e-8bcf-6818b2391e47'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:47 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:18:47 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:47 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6915cc4c-42ac-48f1-b331-387202d21734" returned: 0 in 0.728s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Lock "cinder-quobyte-6915cc4c-42ac-48f1-b331-387202d21734" released by "delete_volume" :: held 1.889s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Created reservations ['53f09d7a-b8ca-43cc-a786-19ac64d304e5', 'cb1ba82c-a3fb-42ce-9c2e-1681f1213533', 'c5d25900-4b6b-4c44-b480-aa4621b813c9', '6d6db635-cd6e-4717-9209-c4ee61279875'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:47 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:18:47 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Acquiring lock "cinder-24e39b6c-2c6e-428f-881c-a9fa4e643c63-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Lock "cinder-24e39b6c-2c6e-428f-881c-a9fa4e643c63-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Flow 'volume_create_manager' (67d1ecb3-a865-433a-a0d9-c478b0c7d296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6008309-62bc-4e6f-8ff6-f2a778df6ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6008309-62bc-4e6f-8ff6-f2a778df6ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-167681651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9193a03d-f5ce-4e97-9cc6-0e67c1c99c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abcb3a4bdbb41ff9f16dffaa89a212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:48Z,use_quota=True,user_id='139cdf5ed90147d69b755b9d117c66da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42623130-e4cf-4cdd-be2c-3fe189468daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42623130-e4cf-4cdd-be2c-3fe189468daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4332830b-0fa1-4fa7-9dd6-49393a2f736d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4332830b-0fa1-4fa7-9dd6-49393a2f736d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9193a03d-f5ce-4e97-9cc6-0e67c1c99c63', 'volume_name': 'volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad5432f-8ae6-4992-9e86-f52e7d990a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad5432f-8ae6-4992-9e86-f52e7d990a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f145df9d-456c-466f-9c42-e9850c980c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:48 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Volume 9193a03d-f5ce-4e97-9cc6-0e67c1c99c63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63', 'volume_size': 1} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-167681651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9193a03d-f5ce-4e97-9cc6-0e67c1c99c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abcb3a4bdbb41ff9f16dffaa89a212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:48Z,use_quota=True,user_id='139cdf5ed90147d69b755b9d117c66da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Creating volume 9193a03d-f5ce-4e97-9cc6-0e67c1c99c63 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:48 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:48 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63 1073741824 Jun 19 04:18:48 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Acquiring lock "cinder-quobyte-24e39b6c-2c6e-428f-881c-a9fa4e643c63" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Lock "cinder-quobyte-24e39b6c-2c6e-428f-881c-a9fa4e643c63" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[311fcd60-b7dc-4534-b944-65db1d75ac98]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:48 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.092s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:48 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Deleted volume successfully. Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3ac0c1eb-1216-4a6e-8e17-b00e4b0a4e93 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-18bc8bff-87a3-4d39-95e0-c0c28cc6dd85-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:48 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63 Jun 19 04:18:48 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:48 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.034s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:48 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Deleted volume successfully. Jun 19 04:18:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dcc6418b-e44b-466a-8693-04885da5ec4a tempest-VolumesTestJSON-955891896 None] Lock "cinder-6915cc4c-42ac-48f1-b331-387202d21734-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:49 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63 1073741824" returned: 0 in 1.211s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:49 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63" returned: 0 in 1.152s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:49 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63 Jun 19 04:18:49 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:49 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63 Jun 19 04:18:49 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:49 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-24e39b6c-2c6e-428f-881c-a9fa4e643c63" returned: 0 in 0.675s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Lock "cinder-quobyte-24e39b6c-2c6e-428f-881c-a9fa4e643c63" released by "delete_volume" :: held 1.876s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Created reservations ['1e852b64-c53a-466b-82c6-f3d06fa09653', 'b40cbfa2-e4fe-495f-a760-c8cb1fbd8039', 'c11328e1-ea49-4642-bc2b-48feb220d181', 'ade40a3d-3c36-4fe6-8fed-ccf1507b25bb'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:50 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63" returned: 0 in 0.715s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f145df9d-456c-466f-9c42-e9850c980c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb741e0e-e1f4-4350-bc75-4b1a47bb2ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:50 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Volume volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63 (9193a03d-f5ce-4e97-9cc6-0e67c1c99c63): created successfully Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb741e0e-e1f4-4350-bc75-4b1a47bb2ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Flow 'volume_create_manager' (67d1ecb3-a865-433a-a0d9-c478b0c7d296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:50 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8148b828-1a22-41a2-94c4-05e6811f300e tempest-VolumesActionsTest-2084830866 None] Created volume successfully. Jun 19 04:18:50 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:18:50 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:50 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.724s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:50 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Deleted volume successfully. Jun 19 04:18:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-a6e44b49-1469-49fe-8c07-c2dccc8bcc28 tempest-VolumesTestJSON-955891896 None] Lock "cinder-24e39b6c-2c6e-428f-881c-a9fa4e643c63-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Acquiring lock "cinder-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Lock "cinder-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Acquiring lock "cinder-quobyte-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Lock "cinder-quobyte-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63" acquired by "delete_volume" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:51 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[874725bb-4b34-4091-8e6d-b1a492d83ee7]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:51 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63 Jun 19 04:18:51 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:52 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63" returned: 0 in 0.954s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:52 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63 Jun 19 04:18:52 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:53 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63" returned: 0 in 0.835s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Lock "cinder-quobyte-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63" released by "delete_volume" :: held 1.859s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:53 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Created reservations ['a55b2013-f423-46f4-90d4-922e0bc269c6', '9c66142d-d1b0-454f-8f02-f8aef7330829', '108ff8aa-5cb5-4cd7-8be8-5aebf8ad1f75', '7102021c-0362-49cd-b6e2-c5a88f603a2b'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:53 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:18:53 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Flow 'volume_create_manager' (044d037f-1cc9-484e-bf91-9c03d0fa505d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ef6fdf-1d40-48cd-808e-63386eed3e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ef6fdf-1d40-48cd-808e-63386eed3e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1971100904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be4a1e2-f9a2-4d70-8927-9c5620c48ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abcb3a4bdbb41ff9f16dffaa89a212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:54Z,use_quota=True,user_id='139cdf5ed90147d69b755b9d117c66da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be3eba0-1cee-44b0-8ccb-9c1525ffdf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be3eba0-1cee-44b0-8ccb-9c1525ffdf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31820333-9e09-4854-b904-3cf03ef07f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:54 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31820333-9e09-4854-b904-3cf03ef07f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be4a1e2-f9a2-4d70-8927-9c5620c48ee1', 'volume_name': 'volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a394c2e0-0d72-4b04-8652-8a7841aaa84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a394c2e0-0d72-4b04-8652-8a7841aaa84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1af7a4-76aa-4ba1-a6e3-7bc3adf61e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:54 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Volume 5be4a1e2-f9a2-4d70-8927-9c5620c48ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1', 'volume_size': 1} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1971100904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be4a1e2-f9a2-4d70-8927-9c5620c48ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abcb3a4bdbb41ff9f16dffaa89a212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:54Z,use_quota=True,user_id='139cdf5ed90147d69b755b9d117c66da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Creating volume 5be4a1e2-f9a2-4d70-8927-9c5620c48ee1 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:54 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.068s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:54 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Deleted volume successfully. Jun 19 04:18:54 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1 1073741824 Jun 19 04:18:54 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42c9645d-9c1a-42bb-83cb-8c649f56845f tempest-VolumesActionsTest-1702494765 None] Lock "cinder-9193a03d-f5ce-4e97-9cc6-0e67c1c99c63-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:55 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1 1073741824" returned: 0 in 1.033s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:55 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1 Jun 19 04:18:55 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:56 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1" returned: 0 in 0.682s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1af7a4-76aa-4ba1-a6e3-7bc3adf61e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30fe63a-b724-4f09-bf93-4859390ad868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:56 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Volume volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1 (5be4a1e2-f9a2-4d70-8927-9c5620c48ee1): created successfully Jun 19 04:18:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30fe63a-b724-4f09-bf93-4859390ad868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Flow 'volume_create_manager' (044d037f-1cc9-484e-bf91-9c03d0fa505d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:56 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-31937883-bcab-43d2-925c-f27beca4f89d tempest-VolumesActionsTest-2084830866 None] Created volume successfully. Jun 19 04:18:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Acquiring lock "cinder-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Acquiring lock "cinder-quobyte-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-quobyte-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1" acquired by "delete_volume" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:56 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[974a86c0-388b-416d-ae90-9274cf603a56]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:56 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1 Jun 19 04:18:56 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:57 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1" returned: 0 in 0.832s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:57 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1 Jun 19 04:18:57 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:58 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1" returned: 0 in 0.828s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-quobyte-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1" released by "delete_volume" :: held 1.718s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:58 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Created reservations ['bae30cbc-fc1e-426a-8395-a14be60af81c', 'c9901bb2-bcb6-4db6-b2f5-da7172b2382d', 'e51b825e-17e5-4999-ad07-e05ab1f1144f', 'c979f6f0-6b8c-4b2a-abc3-03a5a94aeae8'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:58 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:58 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:58 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:18:58 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:59 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.745s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:59 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Deleted volume successfully. Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-37e23a96-3501-48c6-b661-abaa4fdcd0f1 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-5be4a1e2-f9a2-4d70-8927-9c5620c48ee1-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Flow 'volume_create_manager' (4218e8cc-9db6-418c-8a92-064b09b716de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c365a7b1-3e96-4f75-9c5f-38d3030d0c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c365a7b1-3e96-4f75-9c5f-38d3030d0c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-966648408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abcb3a4bdbb41ff9f16dffaa89a212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:59Z,use_quota=True,user_id='139cdf5ed90147d69b755b9d117c66da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36488127-a729-4e86-b2e8-7fe640766b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36488127-a729-4e86-b2e8-7fe640766b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a618ca1-c17d-4a76-b8de-45317b13ec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a618ca1-c17d-4a76-b8de-45317b13ec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b', 'volume_name': 'volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1216c556-25f0-4a41-a3e2-65c3ccb95d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1216c556-25f0-4a41-a3e2-65c3ccb95d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1e641d-dea1-4d87-a672-fd4cf675657d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:59 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Volume 7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b', 'volume_size': 1} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-966648408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abcb3a4bdbb41ff9f16dffaa89a212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:59Z,use_quota=True,user_id='139cdf5ed90147d69b755b9d117c66da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Creating volume 7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:59 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:59 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b 1073741824 Jun 19 04:18:59 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b0aa946-fc81-406a-95df-538f8152094a tempest-BackendsCapabilitiesAdminTestsJSON-570919917 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578201293945, 'free_capacity_gb': 1775.7578201293945, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93300) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 19 04:19:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6ec030e7-bd97-491b-879d-94567213545c tempest-BackendsCapabilitiesAdminTestsJSON-570919917 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578201293945, 'free_capacity_gb': 1775.7578201293945, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93300) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 19 04:19:00 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b 1073741824" returned: 0 in 0.820s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:00 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b Jun 19 04:19:00 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:01 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b" returned: 0 in 0.655s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1e641d-dea1-4d87-a672-fd4cf675657d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4323a045-12da-4e06-bb7f-8950681c9b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:01 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Volume volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b (7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b): created successfully Jun 19 04:19:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4323a045-12da-4e06-bb7f-8950681c9b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Flow 'volume_create_manager' (4218e8cc-9db6-418c-8a92-064b09b716de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:01 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-0ee3f71b-e4c6-4bd4-8962-d9fccbae583c tempest-VolumesActionsTest-2084830866 None] Created volume successfully. Jun 19 04:19:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Acquiring lock "cinder-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Acquiring lock "cinder-quobyte-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-quobyte-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b" acquired by "delete_volume" :: waited 0.021s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:01 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[06de00cb-8aee-4bd5-a06a-003bd6ac689d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:01 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b Jun 19 04:19:01 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:02 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b" returned: 0 in 0.886s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:02 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b Jun 19 04:19:02 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:03 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b" returned: 0 in 0.707s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-quobyte-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b" released by "delete_volume" :: held 1.655s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:03 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Created reservations ['d9d1e49a-e3e8-49f7-ab51-a37bb7efef6e', '0ec0b5a5-a03c-4db1-8a34-2b24d1213b6c', '878eba87-325b-4db0-8cb3-b78fbc4f3d90', '4f5d3427-23ec-4e91-94ef-d9a85aecd8b1'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:03 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:19:03 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:04 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.796s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:04 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Deleted volume successfully. Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-86dd01ae-9244-4213-8c8f-b57bfd50a6e0 tempest-VolumesActionsTest-1702494765 None] Lock "cinder-7f85d599-6f3b-4f8f-95ff-e4b1ca42b61b-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Flow 'volume_create_manager' (87041e30-8395-41ce-88e5-793fd503a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc50717d-c79f-42d6-a219-67fe52d8b0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc50717d-c79f-42d6-a219-67fe52d8b0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1363641759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9647c25-0d92-4f82-8bf6-dc30f515c50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abcb3a4bdbb41ff9f16dffaa89a212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:04Z,use_quota=True,user_id='139cdf5ed90147d69b755b9d117c66da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85635f76-fcb0-490d-91c4-437ac9a69b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85635f76-fcb0-490d-91c4-437ac9a69b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c56a0c-37ae-4f1b-867c-6b4d58b8f3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c56a0c-37ae-4f1b-867c-6b4d58b8f3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9647c25-0d92-4f82-8bf6-dc30f515c50b', 'volume_name': 'volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e5bad7-3eb5-4aba-876d-7ad39054d214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e5bad7-3eb5-4aba-876d-7ad39054d214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c569f90-7886-44db-b8bc-6b74334bebd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:04 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Volume b9647c25-0d92-4f82-8bf6-dc30f515c50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b', 'volume_size': 1} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1363641759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9647c25-0d92-4f82-8bf6-dc30f515c50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abcb3a4bdbb41ff9f16dffaa89a212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:04Z,use_quota=True,user_id='139cdf5ed90147d69b755b9d117c66da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Creating volume b9647c25-0d92-4f82-8bf6-dc30f515c50b {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:04 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:19:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:04 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b 1073741824 Jun 19 04:19:04 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:05 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b 1073741824" returned: 0 in 1.119s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:05 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b Jun 19 04:19:05 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:06 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b" returned: 0 in 0.903s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c569f90-7886-44db-b8bc-6b74334bebd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447d4596-4062-4162-8b9d-6101d89843d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:06 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Volume volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b (b9647c25-0d92-4f82-8bf6-dc30f515c50b): created successfully Jun 19 04:19:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447d4596-4062-4162-8b9d-6101d89843d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Flow 'volume_create_manager' (87041e30-8395-41ce-88e5-793fd503a50e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:06 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4ca5d8ee-37ba-4f15-bf7f-63b83a133ba7 tempest-VolumesActionsTest-2084830866 None] Created volume successfully. Jun 19 04:19:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Acquiring lock "cinder-b9647c25-0d92-4f82-8bf6-dc30f515c50b-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Lock "cinder-b9647c25-0d92-4f82-8bf6-dc30f515c50b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Acquiring lock "cinder-quobyte-b9647c25-0d92-4f82-8bf6-dc30f515c50b" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Lock "cinder-quobyte-b9647c25-0d92-4f82-8bf6-dc30f515c50b" acquired by "delete_volume" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:08 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0c4539-494b-4934-abdc-1b40ef1eca9d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:08 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b Jun 19 04:19:08 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:09 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b" returned: 0 in 0.932s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:09 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b Jun 19 04:19:09 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:10 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b9647c25-0d92-4f82-8bf6-dc30f515c50b" returned: 0 in 0.695s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Lock "cinder-quobyte-b9647c25-0d92-4f82-8bf6-dc30f515c50b" released by "delete_volume" :: held 1.696s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:10 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Created reservations ['268e02f5-78f2-4068-91bc-a06880f1594f', '3abde648-111d-484b-971d-dbd72c89d44d', '0736d9ea-77dc-4a50-8852-7848dfce3f0d', '1bd988b0-b195-401f-9c64-b3804b451960'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:10 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:10 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:10 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:19:10 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:10 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.693s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:10 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:10 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Deleted volume successfully. Jun 19 04:19:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-422183c9-8e1f-4806-9955-eb5c20f1e530 tempest-VolumesActionsTest-2084830866 None] Lock "cinder-b9647c25-0d92-4f82-8bf6-dc30f515c50b-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:19:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:19 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:19:19 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:19 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=116,cinder:SELECT=87,cinder:INSERT=25,cinder:DELETE=10 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:19:19 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2b034ad9-ce2d-4f40-9514-457df9d267d2 tempest-GroupsV314Test-524149298 None] Group tempest-GroupsV314Test-Group-115988202: creating Jun 19 04:19:19 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=88,cinder:UPDATE=121,cinder:INSERT=28,cinder:DELETE=11 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:19:19 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2b034ad9-ce2d-4f40-9514-457df9d267d2 tempest-GroupsV314Test-524149298 None] Group tempest-GroupsV314Test-Group-115988202: created successfully Jun 19 04:19:19 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2b034ad9-ce2d-4f40-9514-457df9d267d2 tempest-GroupsV314Test-524149298 None] Create group completed successfully. Jun 19 04:19:20 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.146s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:20 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:19:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 8 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:19:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Flow 'volume_create_manager' (d4ee5dde-67e4-4e1d-9595-ccd08761b7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051246cd-71f4-467f-a34a-1f9f6640a226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051246cd-71f4-467f-a34a-1f9f6640a226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779250526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31b4c1e9-6c7f-4070-b61d-09d7e18261ba,host='devstack@QuobyteHD#QuobyteHD',id=ae752aef-846c-4175-891f-70cfad799cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559bf5dedd8648ff845b54ec8d3a3b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:22Z,use_quota=True,user_id='6c954a69621e47fdaa2806933c68847a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33fecc6e-381a-4a74-9a43-7b03822cc3d8),volume_type_id=33fecc6e-381a-4a74-9a43-7b03822cc3d8)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51da20b5-bb19-4671-ac08-e471fe2ab6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51da20b5-bb19-4671-ac08-e471fe2ab6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829e1a70-7aa8-4271-8e45-94fa7e377df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829e1a70-7aa8-4271-8e45-94fa7e377df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae752aef-846c-4175-891f-70cfad799cb7', 'volume_name': 'volume-ae752aef-846c-4175-891f-70cfad799cb7', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46346ae-9ce5-4dea-aab5-f0923705610e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46346ae-9ce5-4dea-aab5-f0923705610e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9120bcdf-08a2-4747-9191-d1e6d712f2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:21 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Volume ae752aef-846c-4175-891f-70cfad799cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae752aef-846c-4175-891f-70cfad799cb7', 'volume_size': 1} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=31b4c1e9-6c7f-4070-b61d-09d7e18261ba,created_at=2026-06-19T02:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779250526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31b4c1e9-6c7f-4070-b61d-09d7e18261ba,host='devstack@QuobyteHD#QuobyteHD',id=ae752aef-846c-4175-891f-70cfad799cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559bf5dedd8648ff845b54ec8d3a3b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:22Z,use_quota=True,user_id='6c954a69621e47fdaa2806933c68847a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33fecc6e-381a-4a74-9a43-7b03822cc3d8),volume_type_id=33fecc6e-381a-4a74-9a43-7b03822cc3d8)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Creating volume ae752aef-846c-4175-891f-70cfad799cb7 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:21 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:19:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:21 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 1073741824 Jun 19 04:19:21 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:22 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 1073741824" returned: 0 in 1.193s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:23 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 Jun 19 04:19:23 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:23 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7" returned: 0 in 0.815s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9120bcdf-08a2-4747-9191-d1e6d712f2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae752aef-846c-4175-891f-70cfad799cb7', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fdb24f-0b01-4463-ba5c-e604b51a82a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:23 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Volume volume-ae752aef-846c-4175-891f-70cfad799cb7 (ae752aef-846c-4175-891f-70cfad799cb7): created successfully Jun 19 04:19:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fdb24f-0b01-4463-ba5c-e604b51a82a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:23 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Flow 'volume_create_manager' (d4ee5dde-67e4-4e1d-9595-ccd08761b7fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:23 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3a9f9e63-2583-4ad7-baff-3b6591952015 tempest-GroupsV314Test-524149298 None] Created volume successfully. Jun 19 04:19:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:25 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Cloning volume ae752aef-846c-4175-891f-70cfad799cb7 to volume 4b6e63b9-cbfa-43c4-8638-fae9f0a564d6 Jun 19 04:19:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Creating offline snapshot 9eae142d-16cb-4c8d-88d6-a4ed032e64b0 of volume ae752aef-846c-4175-891f-70cfad799cb7 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:19:25 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[164c8acd-8bfd-4457-8ab0-a01c35b5b6de]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:25 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 Jun 19 04:19:25 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:26 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7" returned: 0 in 0.982s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:26 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 1G Jun 19 04:19:26 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:27 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 1G" returned: 0 in 0.893s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae752aef-846c-4175-891f-70cfad799cb7 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:27 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae752aef-846c-4175-891f-70cfad799cb7 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 Jun 19 04:19:27 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Flow 'volume_create_manager' (5f752c6b-0d50-4f8c-840f-05bed82e02ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9383c8a-0b46-4cd5-80b6-07523e48fb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9383c8a-0b46-4cd5-80b6-07523e48fb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-878226664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794c014c-bbd2-4928-b427-dd437532e0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4f734f37a5466bae94755cd6f0d775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:27Z,use_quota=True,user_id='06b77cb70408443da57d08e0cf5f9b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd73a5de-1740-4d55-ad0e-a1e733220693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd73a5de-1740-4d55-ad0e-a1e733220693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e73abe-a5e9-407b-a4b7-c6e362fb474c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e73abe-a5e9-407b-a4b7-c6e362fb474c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794c014c-bbd2-4928-b427-dd437532e0ec', 'volume_name': 'volume-794c014c-bbd2-4928-b427-dd437532e0ec', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395f5ef5-a25c-40ea-8587-3320c2724742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395f5ef5-a25c-40ea-8587-3320c2724742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36864b98-4805-493c-b9c1-4f1d098f50e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:27 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Volume 794c014c-bbd2-4928-b427-dd437532e0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794c014c-bbd2-4928-b427-dd437532e0ec', 'volume_size': 1} Jun 19 04:19:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:28 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae752aef-846c-4175-891f-70cfad799cb7 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0" returned: 0 in 0.677s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:28 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:19:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:28 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 Jun 19 04:19:28 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:28 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0" returned: 0 in 0.678s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:28 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.info Jun 19 04:19:28 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:29 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.info" returned: 0 in 0.627s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:29 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:19:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:29 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.info Jun 19 04:19:29 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:29 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.info" returned: 0 in 0.604s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Acquiring lock "cinder-quobyte-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6" by "_copy_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Lock "cinder-quobyte-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] snapshot: 9eae142d-16cb-4c8d-88d6-a4ed032e64b0, volume: 4b6e63b9-cbfa-43c4-8638-fae9f0a564d6, {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b2526c-3f50-4ddf-ac2c-5940e34976e5]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:30 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 Jun 19 04:19:30 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:30 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0" returned: 0 in 0.725s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae752aef-846c-4175-891f-70cfad799cb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Creating direct copy from snapshot {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3516bb29-6612-4c1d-ae3b-127c9ebdd62c]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:30 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 Jun 19 04:19:30 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:31 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7" returned: 0 in 0.739s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:31 devstack cinder-volume[93300]: DEBUG cinder.utils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Path /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6 not found in is_blk_device check {{(pid=93300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:19:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:31 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6 Jun 19 04:19:31 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:37 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6" returned: 0 in 5.540s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:37 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[03233147-8d96-4aa8-8693-5d98e27e1bbc]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:37 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 Jun 19 04:19:37 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:38 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7" returned: 0 in 0.938s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:19:38 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Converted 1024.00 MB image at 184.78 MB/s Jun 19 04:19:38 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:38 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6 Jun 19 04:19:38 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Flow 'volume_create_manager' (c7ee560d-91a4-4fe2-82c3-288d3045d203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b08ab1-31ec-4035-8bc4-2b4c1347df6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b08ab1-31ec-4035-8bc4-2b4c1347df6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1276711067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b67ad1-56ad-49f2-9690-86c99f713028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d0e6c92a4540f79531cbf8275f6683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:39Z,use_quota=True,user_id='41e97d44b6a946709ef0296861669188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cefd712-4de0-422e-83ff-c17122d5c427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cefd712-4de0-422e-83ff-c17122d5c427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f832e38d-9950-45c4-b14b-5660c5e2eaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f832e38d-9950-45c4-b14b-5660c5e2eaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3b67ad1-56ad-49f2-9690-86c99f713028', 'volume_name': 'volume-a3b67ad1-56ad-49f2-9690-86c99f713028', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0401e63-df89-427f-b972-b0da20e2af49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0401e63-df89-427f-b972-b0da20e2af49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231f28f5-6d74-473a-af44-f022e90d0a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:38 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Volume a3b67ad1-56ad-49f2-9690-86c99f713028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3b67ad1-56ad-49f2-9690-86c99f713028', 'volume_size': 1} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:38 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6" returned: 0 in 0.697s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Lock "cinder-quobyte-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6" released by "_copy_volume_from_snapshot" :: held 8.729s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Acquiring lock "cinder-quobyte-9eae142d-16cb-4c8d-88d6-a4ed032e64b0" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Lock "cinder-quobyte-9eae142d-16cb-4c8d-88d6-a4ed032e64b0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Deleting offline snapshot 9eae142d-16cb-4c8d-88d6-a4ed032e64b0 of volume ae752aef-846c-4175-891f-70cfad799cb7 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] snapshot_file for this snap is: volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e410b6f6-fc6f-4da4-945c-57f3dd6bf1e2]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:38 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 Jun 19 04:19:38 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:39 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0" returned: 0 in 0.765s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae752aef-846c-4175-891f-70cfad799cb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:19:39 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d798b2b-33dc-4351-acdf-7077527393b2]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:39 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 Jun 19 04:19:39 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:40 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7" returned: 0 in 0.717s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:40 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 Jun 19 04:19:40 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:41 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0" returned: 0 in 0.756s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:41 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0 Jun 19 04:19:41 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:41 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7.9eae142d-16cb-4c8d-88d6-a4ed032e64b0" returned: 0 in 0.664s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Lock "cinder-quobyte-9eae142d-16cb-4c8d-88d6-a4ed032e64b0" released by "_delete_snapshot" :: held 2.997s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.399s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.228s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-878226664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794c014c-bbd2-4928-b427-dd437532e0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4f734f37a5466bae94755cd6f0d775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:27Z,use_quota=True,user_id='06b77cb70408443da57d08e0cf5f9b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Creating volume 794c014c-bbd2-4928-b427-dd437532e0ec {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:41 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:19:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-794c014c-bbd2-4928-b427-dd437532e0ec 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:41 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-794c014c-bbd2-4928-b427-dd437532e0ec 1073741824 Jun 19 04:19:41 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:41 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4ec7fae6-6059-4ec7-9244-03f0aeef382d tempest-GroupsV314Test-524149298 None] Create group from source-group-31b4c1e9-6c7f-4070-b61d-09d7e18261ba completed successfully. Jun 19 04:19:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Acquiring lock "cinder-quobyte-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Lock "cinder-quobyte-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6" acquired by "delete_volume" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:42 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[891af21a-5b8f-4e56-814c-200bdad96a0e]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:42 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6 Jun 19 04:19:42 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:42 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-794c014c-bbd2-4928-b427-dd437532e0ec 1073741824" returned: 0 in 0.877s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-794c014c-bbd2-4928-b427-dd437532e0ec {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:42 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-794c014c-bbd2-4928-b427-dd437532e0ec Jun 19 04:19:42 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:43 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6" returned: 0 in 0.797s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:43 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6 Jun 19 04:19:43 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:43 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-794c014c-bbd2-4928-b427-dd437532e0ec" returned: 0 in 0.660s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.653s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1276711067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b67ad1-56ad-49f2-9690-86c99f713028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d0e6c92a4540f79531cbf8275f6683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:39Z,use_quota=True,user_id='41e97d44b6a946709ef0296861669188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Creating volume a3b67ad1-56ad-49f2-9690-86c99f713028 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:43 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36864b98-4805-493c-b9c1-4f1d098f50e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794c014c-bbd2-4928-b427-dd437532e0ec', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:43 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028 1073741824 Jun 19 04:19:43 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07445417-99b6-4984-a74d-0f3242f98ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:43 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Volume volume-794c014c-bbd2-4928-b427-dd437532e0ec (794c014c-bbd2-4928-b427-dd437532e0ec): created successfully Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07445417-99b6-4984-a74d-0f3242f98ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Flow 'volume_create_manager' (5f752c6b-0d50-4f8c-840f-05bed82e02ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:43 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-438b64c0-7e1b-428d-8536-ae74bb9ba330 tempest-AbsoluteLimitsTests-1983352503 None] Created volume successfully. Jun 19 04:19:43 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6" returned: 0 in 0.664s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Lock "cinder-quobyte-4b6e63b9-cbfa-43c4-8638-fae9f0a564d6" released by "delete_volume" :: held 1.501s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Created reservations ['2b40cc3a-eb5a-46d3-af9b-c6ada2dd59d2'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Acquiring lock "cinder-794c014c-bbd2-4928-b427-dd437532e0ec-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:44 devstack cinder-volume[93300]: WARNING cinder.quota [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-282501509 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-282501509, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:19:44 devstack cinder-volume[93300]: WARNING cinder.quota [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-282501509 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-282501509, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Lock "cinder-794c014c-bbd2-4928-b427-dd437532e0ec-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Created reservations ['03566c5d-e35e-44f4-aad4-820a0d6275ec', '1d952e3e-a21a-4390-bfc1-d1fb093c2d33', '7764ba16-ce21-4c39-8686-bdeb8a0a329d', '1c51a21b-9d28-45fd-83ff-0e43e7603780'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Acquiring lock "cinder-quobyte-794c014c-bbd2-4928-b427-dd437532e0ec" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Lock "cinder-quobyte-794c014c-bbd2-4928-b427-dd437532e0ec" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc7fa52-78bc-417e-803c-19c80a491fb4]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-794c014c-bbd2-4928-b427-dd437532e0ec {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:44 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028 1073741824" returned: 0 in 0.883s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:44 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:19:44 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:44 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-794c014c-bbd2-4928-b427-dd437532e0ec Jun 19 04:19:44 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:44 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028 Jun 19 04:19:44 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:44 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.740s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:44 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:44 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-fcf21233-7514-4d90-996f-a481baa50fd9 tempest-GroupsV314Test-524149298 None] Delete group completed successfully. Jun 19 04:19:45 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028" returned: 0 in 0.760s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231f28f5-6d74-473a-af44-f022e90d0a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3b67ad1-56ad-49f2-9690-86c99f713028', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479674d5-248e-4dad-80a7-d15da5dd0ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:45 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-794c014c-bbd2-4928-b427-dd437532e0ec" returned: 0 in 0.914s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-794c014c-bbd2-4928-b427-dd437532e0ec {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Acquiring lock "cinder-quobyte-ae752aef-846c-4175-891f-70cfad799cb7" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:45 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Volume volume-a3b67ad1-56ad-49f2-9690-86c99f713028 (a3b67ad1-56ad-49f2-9690-86c99f713028): created successfully Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479674d5-248e-4dad-80a7-d15da5dd0ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:45 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-794c014c-bbd2-4928-b427-dd437532e0ec Jun 19 04:19:45 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Flow 'volume_create_manager' (c7ee560d-91a4-4fe2-82c3-288d3045d203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Lock "cinder-quobyte-ae752aef-846c-4175-891f-70cfad799cb7" acquired by "delete_volume" :: waited 0.034s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:45 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-776cd6ff-3f3e-4486-b0db-690aa33dbeb8 tempest-AttachVolumeNegativeTest-1515607248 None] Created volume successfully. Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[838e3592-0289-4c1d-89fc-cd70f6af931c]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:45 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 Jun 19 04:19:45 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:45 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-794c014c-bbd2-4928-b427-dd437532e0ec" returned: 0 in 0.675s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Lock "cinder-quobyte-794c014c-bbd2-4928-b427-dd437532e0ec" released by "delete_volume" :: held 1.641s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Created reservations ['1e35558a-65dc-4f18-afad-cfa5405756cc', 'eb609277-193a-4d1d-8327-c55033f841b3', 'f5df9357-abd6-45f9-b375-42a01107fdd6', 'd61d56ec-6c6d-4efe-81ef-2add62670edf'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:45 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:19:45 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:45 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7" returned: 0 in 0.763s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:45 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7 Jun 19 04:19:45 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:46 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae752aef-846c-4175-891f-70cfad799cb7" returned: 0 in 0.678s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:46 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.741s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:46 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Lock "cinder-quobyte-ae752aef-846c-4175-891f-70cfad799cb7" released by "delete_volume" :: held 1.535s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:46 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Deleted volume successfully. Jun 19 04:19:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d4bc6711-ed3f-471b-8a7e-b7eb0239b5fb tempest-AbsoluteLimitsTests-1983352503 None] Lock "cinder-794c014c-bbd2-4928-b427-dd437532e0ec-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:46 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Created reservations ['1bac0ef3-2d6e-4c2d-8e85-bbeee573944f'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:46 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Created reservations ['80a28f83-36c2-4e92-afe1-eda9b9d412f0', '05a19479-b154-4943-9e7c-a853d04fefbf', '513392c0-65d8-4281-bb72-25d5908778df', 'f8335f95-d329-4672-8a5d-7cff5fa82fd6'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:46 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:19:46 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:47 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.701s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:47 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:47 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-fbdbe100-4561-41de-8c0e-1899b427258e tempest-GroupsV314Test-524149298 None] Delete group completed successfully. Jun 19 04:19:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-39466897-ca02-42c7-8e13-110ecf1fb2be req-d03821af-5ff8-4321-8d8a-9ef427d25bd5 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-39466897-ca02-42c7-8e13-110ecf1fb2be req-d03821af-5ff8-4321-8d8a-9ef427d25bd5 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:49 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb48319-e143-4da8-a8a9-59c29febee39]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-39466897-ca02-42c7-8e13-110ecf1fb2be req-d03821af-5ff8-4321-8d8a-9ef427d25bd5 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:50 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028 Jun 19 04:19:50 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:50 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-39466897-ca02-42c7-8e13-110ecf1fb2be req-d03821af-5ff8-4321-8d8a-9ef427d25bd5 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028" returned: 0 in 0.994s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-39466897-ca02-42c7-8e13-110ecf1fb2be req-d03821af-5ff8-4321-8d8a-9ef427d25bd5 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.016s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-39466897-ca02-42c7-8e13-110ecf1fb2be req-d03821af-5ff8-4321-8d8a-9ef427d25bd5 tempest-AttachVolumeNegativeTest-1515607248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-a3b67ad1-56ad-49f2-9690-86c99f713028', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '108d83ce-c0b3-4dcf-91f1-bac71857cef4', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:19:51 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-39466897-ca02-42c7-8e13-110ecf1fb2be req-d03821af-5ff8-4321-8d8a-9ef427d25bd5 tempest-AttachVolumeNegativeTest-1515607248 None] attachment_update completed successfully. Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Flow 'volume_create_manager' (0e46262e-3f5c-4c2e-8683-7fb38334add4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c59e73-4476-4b51-9020-3e09c8dd16a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c59e73-4476-4b51-9020-3e09c8dd16a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-434798870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2b732f-3cf1-427a-bd36-0eb7201a9f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c9b3c1c844474cab4f8d19f9956962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:53Z,use_quota=True,user_id='f8a83a2f1e234633ac1e6142853c5689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6535ef3-6c26-48fe-8e41-e646fde317a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6535ef3-6c26-48fe-8e41-e646fde317a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0386d024-1379-4514-8e80-8b47eadf02a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0386d024-1379-4514-8e80-8b47eadf02a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b2b732f-3cf1-427a-bd36-0eb7201a9f6b', 'volume_name': 'volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99498dd9-22a9-4932-990e-b3e7428b9d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99498dd9-22a9-4932-990e-b3e7428b9d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d43a8b-1344-4b4d-bc7a-cce2b865d0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:53 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Volume 1b2b732f-3cf1-427a-bd36-0eb7201a9f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b', 'volume_size': 1} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-434798870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2b732f-3cf1-427a-bd36-0eb7201a9f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c9b3c1c844474cab4f8d19f9956962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:53Z,use_quota=True,user_id='f8a83a2f1e234633ac1e6142853c5689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Creating volume 1b2b732f-3cf1-427a-bd36-0eb7201a9f6b {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:53 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:19:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:53 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b 1073741824 Jun 19 04:19:53 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:54 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b 1073741824" returned: 0 in 0.898s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:54 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b Jun 19 04:19:54 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:55 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b" returned: 0 in 0.655s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d43a8b-1344-4b4d-bc7a-cce2b865d0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2da76e2-96fe-47fc-a2af-14b3e3fbc0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:55 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Volume volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b (1b2b732f-3cf1-427a-bd36-0eb7201a9f6b): created successfully Jun 19 04:19:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2da76e2-96fe-47fc-a2af-14b3e3fbc0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Flow 'volume_create_manager' (0e46262e-3f5c-4c2e-8683-7fb38334add4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:55 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-11510452-8b66-4c76-a456-db85cca9448e tempest-VolumesTransfersTest-2002890727 None] Created volume successfully. Jun 19 04:19:56 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-425f5b2c-9fab-40ba-9a1c-5fbd5569d96d tempest-VolumesTransfersTest-1668298724 None] Transfer volume completed successfully. Jun 19 04:19:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Acquiring lock "cinder-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Lock "cinder-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Acquiring lock "cinder-quobyte-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Lock "cinder-quobyte-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b" acquired by "delete_volume" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:57 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca3156d-d0c8-4dcf-8a3a-5b1d524f8cf7]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:57 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b Jun 19 04:19:57 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:57 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-97ed9901-ba66-41f3-a4cf-2c1febb206e8 req-944634c8-7a2c-48f2-a2e0-76daaf46d363 tempest-AttachVolumeNegativeTest-1515607248 None] Terminate volume connection completed successfully. Jun 19 04:19:57 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-97ed9901-ba66-41f3-a4cf-2c1febb206e8 req-944634c8-7a2c-48f2-a2e0-76daaf46d363 tempest-AttachVolumeNegativeTest-1515607248 None] Deleting attachment 108d83ce-c0b3-4dcf-91f1-bac71857cef4. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:19:58 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b" returned: 0 in 0.892s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:58 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b Jun 19 04:19:58 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:59 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b" returned: 0 in 0.678s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Lock "cinder-quobyte-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b" released by "delete_volume" :: held 1.621s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:59 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Created reservations ['4488c5fa-90c5-4d12-a751-15dd7e176541', 'e6fc2386-9bff-4a94-a40f-00d3749b062d', 'b33dff45-3c2e-4f73-b5b3-88f885ea7e9a', '842f6adb-0da5-4dde-8108-855b9a8a7de0'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:59 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:19:59 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:00 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.995s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:00 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Deleted volume successfully. Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-aad974f6-83d8-440c-b1f3-8a6e1e26d535 tempest-VolumesTransfersTest-1175610252 None] Lock "cinder-1b2b732f-3cf1-427a-bd36-0eb7201a9f6b-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Flow 'volume_create_manager' (45e75682-b391-4b4a-8899-770536d5e2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa6c995-8062-45b2-a115-eb55a8b13235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa6c995-8062-45b2-a115-eb55a8b13235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1622496695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f15f74-ab9e-4a49-bdff-e2f34851d7e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c9b3c1c844474cab4f8d19f9956962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:00Z,use_quota=True,user_id='f8a83a2f1e234633ac1e6142853c5689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae46087-79fd-4430-9388-2f172cb4f377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae46087-79fd-4430-9388-2f172cb4f377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72aec695-f569-4a8a-99d0-b97ceb8b8899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72aec695-f569-4a8a-99d0-b97ceb8b8899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f15f74-ab9e-4a49-bdff-e2f34851d7e4', 'volume_name': 'volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7172c5-9ec7-4789-bbf2-3b4b8ac8823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7172c5-9ec7-4789-bbf2-3b4b8ac8823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd8ee20-bc54-4dce-a715-c7b9ed6f7ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:00 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Volume 48f15f74-ab9e-4a49-bdff-e2f34851d7e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4', 'volume_size': 1} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1622496695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f15f74-ab9e-4a49-bdff-e2f34851d7e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c9b3c1c844474cab4f8d19f9956962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:00Z,use_quota=True,user_id='f8a83a2f1e234633ac1e6142853c5689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Creating volume 48f15f74-ab9e-4a49-bdff-e2f34851d7e4 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:00 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:20:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:00 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4 1073741824 Jun 19 04:20:00 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:01 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4 1073741824" returned: 0 in 1.312s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:02 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4 Jun 19 04:20:02 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:02 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4" returned: 0 in 0.728s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd8ee20-bc54-4dce-a715-c7b9ed6f7ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2744c5e6-5f84-4a13-8336-9abb4e76f4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:02 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Volume volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4 (48f15f74-ab9e-4a49-bdff-e2f34851d7e4): created successfully Jun 19 04:20:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2744c5e6-5f84-4a13-8336-9abb4e76f4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Flow 'volume_create_manager' (45e75682-b391-4b4a-8899-770536d5e2a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:02 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4149d3fe-0c89-40b1-b8c5-2be46a40a565 tempest-VolumesTransfersTest-2002890727 None] Created volume successfully. Jun 19 04:20:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Acquiring lock "cinder-48f15f74-ab9e-4a49-bdff-e2f34851d7e4-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Lock "cinder-48f15f74-ab9e-4a49-bdff-e2f34851d7e4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Acquiring lock "cinder-quobyte-48f15f74-ab9e-4a49-bdff-e2f34851d7e4" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Lock "cinder-quobyte-48f15f74-ab9e-4a49-bdff-e2f34851d7e4" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:04 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d4fd53-91e3-4a4e-be11-47a4c7cd0e54]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:04 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4 Jun 19 04:20:04 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:04 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4" returned: 0 in 0.763s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:04 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4 Jun 19 04:20:04 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:05 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-48f15f74-ab9e-4a49-bdff-e2f34851d7e4" returned: 0 in 0.677s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Lock "cinder-quobyte-48f15f74-ab9e-4a49-bdff-e2f34851d7e4" released by "delete_volume" :: held 1.481s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:05 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Created reservations ['8e5c5334-6594-4ef6-b918-770a620d1574', 'e274d545-5ff0-4262-ab36-a29a749aaea7', '823fbcb4-6fc8-471b-86a4-f13c748d7a78', 'dc7a616f-e2eb-40a3-a726-c65e3117dc64'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:05 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:20:05 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:06 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.689s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:06 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:06 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Deleted volume successfully. Jun 19 04:20:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2d6f3356-6933-47ca-8a2e-52d42340c6da tempest-VolumesTransfersTest-1175610252 None] Lock "cinder-48f15f74-ab9e-4a49-bdff-e2f34851d7e4-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "cinder-a3b67ad1-56ad-49f2-9690-86c99f713028-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "cinder-a3b67ad1-56ad-49f2-9690-86c99f713028-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "cinder-quobyte-a3b67ad1-56ad-49f2-9690-86c99f713028" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "cinder-quobyte-a3b67ad1-56ad-49f2-9690-86c99f713028" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:09 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[57384807-cf29-4ef4-a138-f9d80872717a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:09 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028 Jun 19 04:20:09 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:10 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028" returned: 0 in 0.962s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:10 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028 Jun 19 04:20:10 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:10 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a3b67ad1-56ad-49f2-9690-86c99f713028" returned: 0 in 0.828s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "cinder-quobyte-a3b67ad1-56ad-49f2-9690-86c99f713028" released by "delete_volume" :: held 1.842s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:11 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Created reservations ['de8c9270-37d1-4971-9d73-1bb3d23e9b47', 'f3ac8683-a7ca-499a-8296-13405a6f720b', '7368de10-0e79-473f-b9b6-f5c38280124d', '502388ce-6c27-46b2-abd6-d1dd9298475d'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:11 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:20:11 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "cinder-84df69ee-2106-47ac-ac68-9ea91ff163d0-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "cinder-84df69ee-2106-47ac-ac68-9ea91ff163d0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "cinder-quobyte-84df69ee-2106-47ac-ac68-9ea91ff163d0" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "cinder-quobyte-84df69ee-2106-47ac-ac68-9ea91ff163d0" acquired by "delete_volume" :: waited 0.036s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:11 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43e8819-81fb-4976-9aed-310a605b2387]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:11 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0 Jun 19 04:20:11 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:12 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.969s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:12 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Deleted volume successfully. Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ca918cd5-d6bc-4ec3-8cb0-bee02c92d314 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "cinder-a3b67ad1-56ad-49f2-9690-86c99f713028-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Flow 'volume_create_manager' (8204fc8d-5ea1-4892-a0c0-a57b3dba8cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fff0d26-96ba-4e28-8dea-fd9c68b050fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fff0d26-96ba-4e28-8dea-fd9c68b050fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1221792726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90fc268d-e17b-49ee-932a-9b4e9cbf3d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e17fe50aee4ae79a10f85b96b63e5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:13Z,use_quota=True,user_id='b853054a255b4bfaaa4c9758d9193a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32c2bb4-129e-4224-a1ea-b57ba8511885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32c2bb4-129e-4224-a1ea-b57ba8511885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a7c53d8-1589-47c9-9406-8902ec027246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:12 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a7c53d8-1589-47c9-9406-8902ec027246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90fc268d-e17b-49ee-932a-9b4e9cbf3d96', 'volume_name': 'volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b923b3c6-12b0-42a5-a3c4-5a58d4edd843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b923b3c6-12b0-42a5-a3c4-5a58d4edd843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594c81bf-7df4-49d8-9559-1a36db690442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:12 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Volume 90fc268d-e17b-49ee-932a-9b4e9cbf3d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96', 'volume_size': 1} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1221792726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90fc268d-e17b-49ee-932a-9b4e9cbf3d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e17fe50aee4ae79a10f85b96b63e5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:13Z,use_quota=True,user_id='b853054a255b4bfaaa4c9758d9193a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Creating volume 90fc268d-e17b-49ee-932a-9b4e9cbf3d96 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:12 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0" returned: 0 in 1.032s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:12 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96 1073741824 Jun 19 04:20:12 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:12 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0 Jun 19 04:20:12 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Flow 'volume_create_manager' (c7d8848f-08b1-4b86-a7c4-0f4d57a38df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af2a0f2-aa25-423d-abab-b30e1c595d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af2a0f2-aa25-423d-abab-b30e1c595d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2100564727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f700e8e-1a78-4bee-b280-ec44b16b96f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a514d4350d48d5a84a2f536bef8255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:13Z,use_quota=True,user_id='06b93143388a470fb5a02eabd5f43625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d7dbad-2b60-47ef-b230-ae42e16f5ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d7dbad-2b60-47ef-b230-ae42e16f5ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f629a3-07e0-41c8-83ca-1ef59ea9e993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f629a3-07e0-41c8-83ca-1ef59ea9e993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f700e8e-1a78-4bee-b280-ec44b16b96f8', 'volume_name': 'volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8bf2b8-e5da-412d-ac8a-1678db70f779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8bf2b8-e5da-412d-ac8a-1678db70f779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db26e25e-9f61-4ce8-8d4d-de5eda83056b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:13 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Volume 0f700e8e-1a78-4bee-b280-ec44b16b96f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8', 'volume_size': 1} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:13 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84df69ee-2106-47ac-ac68-9ea91ff163d0" returned: 0 in 0.713s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "cinder-quobyte-84df69ee-2106-47ac-ac68-9ea91ff163d0" released by "delete_volume" :: held 1.817s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Created reservations ['b77255c1-abda-43c9-bd74-55cf606a82cd', '00574cd3-47a1-4356-bbc3-819f6704ab0c', 'af6e6438-6dde-4437-a9e2-060647050ec7', '5aad4d8b-725c-41d7-bab2-683e90d0473b'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:13 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:20:13 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:13 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96 1073741824" returned: 0 in 0.921s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:13 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96 Jun 19 04:20:13 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "cinder-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "cinder-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "cinder-quobyte-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "cinder-quobyte-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0097afaa-f364-4855-9350-966910e16e06]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:14 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.650s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:14 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Deleted volume successfully. Jun 19 04:20:14 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2 Jun 19 04:20:14 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83c4082e-9894-4155-9c91-9f5ea9313e24 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "cinder-84df69ee-2106-47ac-ac68-9ea91ff163d0-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:14 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96" returned: 0 in 0.680s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2100564727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f700e8e-1a78-4bee-b280-ec44b16b96f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a514d4350d48d5a84a2f536bef8255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:13Z,use_quota=True,user_id='06b93143388a470fb5a02eabd5f43625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Creating volume 0f700e8e-1a78-4bee-b280-ec44b16b96f8 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:14 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594c81bf-7df4-49d8-9559-1a36db690442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:14 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 1073741824 Jun 19 04:20:14 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ff5ed9-9998-4214-ae57-b76303cec3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:14 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Volume volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96 (90fc268d-e17b-49ee-932a-9b4e9cbf3d96): created successfully Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ff5ed9-9998-4214-ae57-b76303cec3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Flow 'volume_create_manager' (8204fc8d-5ea1-4892-a0c0-a57b3dba8cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:14 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c8d5a600-4a25-4307-9e21-5612072c25de tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Created volume successfully. Jun 19 04:20:14 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2" returned: 0 in 0.792s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:14 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2 Jun 19 04:20:14 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:15 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 1073741824" returned: 0 in 0.939s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:15 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 Jun 19 04:20:15 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:15 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2" returned: 0 in 0.674s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "cinder-quobyte-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2" released by "delete_volume" :: held 1.520s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Created reservations ['2f33170a-e2c1-492b-aa0b-254a29d31895', '10be178a-c174-4d4d-abdc-305b24eafd8a', 'c12a384a-806a-4d86-89d3-5788f35b9b17', '81ab6f7f-d691-4223-9778-28e2123ac21a'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Acquiring lock "cinder-90fc268d-e17b-49ee-932a-9b4e9cbf3d96-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Lock "cinder-90fc268d-e17b-49ee-932a-9b4e9cbf3d96-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:15 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:20:15 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Acquiring lock "cinder-quobyte-90fc268d-e17b-49ee-932a-9b4e9cbf3d96" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Lock "cinder-quobyte-90fc268d-e17b-49ee-932a-9b4e9cbf3d96" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[97080ea6-179d-4141-a1cc-eeda3001476e]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:15 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96 Jun 19 04:20:15 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:16 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8" returned: 0 in 0.742s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db26e25e-9f61-4ce8-8d4d-de5eda83056b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35b63fe-5c1b-4068-996b-a44b4a2efd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:16 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Volume volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 (0f700e8e-1a78-4bee-b280-ec44b16b96f8): created successfully Jun 19 04:20:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35b63fe-5c1b-4068-996b-a44b4a2efd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Flow 'volume_create_manager' (c7d8848f-08b1-4b86-a7c4-0f4d57a38df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-de0cc5e7-bbf4-4887-b93d-265e3675c66c tempest-VolumesCloneTest-1523761031 None] Created volume successfully. Jun 19 04:20:16 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.764s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:16 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Deleted volume successfully. Jun 19 04:20:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c606cc57-bdde-43f8-b5d7-9be89766f657 tempest-AttachVolumeNegativeTest-1515607248 None] Lock "cinder-7ebfdf77-3b7b-4ff8-9f09-146e4a788df2-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:16 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96" returned: 0 in 0.856s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:16 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96 Jun 19 04:20:16 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Flow 'volume_create_manager' (0071051f-e851-41a2-aace-6515d4ff8df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ed6431-7f1f-4f9a-892e-6b8575d48927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ed6431-7f1f-4f9a-892e-6b8575d48927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1144176925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a514d4350d48d5a84a2f536bef8255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=0f700e8e-1a78-4bee-b280-ec44b16b96f8,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:17Z,use_quota=True,user_id='06b93143388a470fb5a02eabd5f43625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626e4f4a-fa1b-4318-8dc2-f05037bb7b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626e4f4a-fa1b-4318-8dc2-f05037bb7b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c4670d-f6bf-48d2-9e3e-a4d03fad586e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c4670d-f6bf-48d2-9e3e-a4d03fad586e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb', 'volume_name': 'volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb', 'volume_size': 2, 'source_volid': '0f700e8e-1a78-4bee-b280-ec44b16b96f8', 'source_volstatus': 'available'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e917969-068d-4bdc-96f2-f8857c4be02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e917969-068d-4bdc-96f2-f8857c4be02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7cf8c57-503c-4df2-8043-bc065754ab90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:17 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Volume 2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb', 'volume_size': 2, 'source_volid': '0f700e8e-1a78-4bee-b280-ec44b16b96f8', 'source_volstatus': 'available'} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:17 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Cloning volume 0f700e8e-1a78-4bee-b280-ec44b16b96f8 to volume 2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Creating offline snapshot 83440b6b-c594-41b7-9531-94dcbb85c1e0 of volume 0f700e8e-1a78-4bee-b280-ec44b16b96f8 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e4915e-15b7-4d23-9c37-64d304cff3f4]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:17 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 Jun 19 04:20:17 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:17 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90fc268d-e17b-49ee-932a-9b4e9cbf3d96" returned: 0 in 0.774s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Lock "cinder-quobyte-90fc268d-e17b-49ee-932a-9b4e9cbf3d96" released by "delete_volume" :: held 1.675s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Created reservations ['456b10f0-7e6e-40f7-973c-e977f186e743', '4aa4d2c1-619b-481f-9cb3-998dde12dc81', '6f6e43f8-1a18-445a-bfdb-ee8b6598eb6b', 'd740c2fd-c020-445d-a0e4-d5329f2ac20c'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:17 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:20:17 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:18 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8" returned: 0 in 0.866s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:18 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 1G Jun 19 04:20:18 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:18 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.705s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:18 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:18 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Deleted volume successfully. Jun 19 04:20:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8a3ca267-adaa-4292-bfb1-a58f787d223a tempest-VolumeQuotasNegativeTestJSON-1416218668 None] Lock "cinder-90fc268d-e17b-49ee-932a-9b4e9cbf3d96-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:19 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 1G" returned: 0 in 1.033s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:19 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 Jun 19 04:20:19 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:19 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:20:19 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.774s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:19 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 8 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:20:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:20:20 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0" returned: 0 in 0.929s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:20 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 is being set with open permissions: ugo+rw Jun 19 04:20:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:20 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 Jun 19 04:20:20 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:20 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0" returned: 0 in 0.897s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:20 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=106,cinder:SELECT=76,cinder:INSERT=27,cinder:DELETE=6 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:20:20 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=91,cinder:UPDATE=105,cinder:DELETE=8,cinder:INSERT=21 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:20:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:21 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.info Jun 19 04:20:21 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:21 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.info" returned: 0 in 0.816s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:21 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.info is being set with open permissions: ugo+rw Jun 19 04:20:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:21 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.info Jun 19 04:20:21 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:21 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-cf38e892-a044-4ddd-99d6-fce47c52763c req-ab46006a-6f43-4951-bbc9-d4870d01209b tempest-AttachVolumeTestJSON-1314088858 None] Terminate volume connection completed successfully. Jun 19 04:20:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-cf38e892-a044-4ddd-99d6-fce47c52763c req-ab46006a-6f43-4951-bbc9-d4870d01209b tempest-AttachVolumeTestJSON-1314088858 None] Deleting attachment 18addcca-3014-4d4b-9d56-4cd1d8c192f7. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:20:22 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.info" returned: 0 in 0.835s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Acquiring lock "cinder-quobyte-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb" by "_copy_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Lock "cinder-quobyte-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:22 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] snapshot: 83440b6b-c594-41b7-9531-94dcbb85c1e0, volume: 2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb, {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:20:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:22 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:22 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:22 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfd8a74-d518-41be-ad0a-6cc5d9018756]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:22 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 Jun 19 04:20:22 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:23 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0" returned: 0 in 0.792s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:20:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:20:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Creating direct copy from snapshot {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:20:23 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baf17a8-6416-475f-9bd7-27c9f59cb1bd]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:23 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 Jun 19 04:20:23 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:24 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8" returned: 0 in 0.948s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:24 devstack cinder-volume[93300]: DEBUG cinder.utils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Path /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb not found in is_blk_device check {{(pid=93300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:20:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:24 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb Jun 19 04:20:24 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Flow 'volume_create_manager' (4a5c84c9-d53e-417c-80b8-c1daea6f28ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777ee730-7ede-4e19-8cca-ef27b04e320a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777ee730-7ede-4e19-8cca-ef27b04e320a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-618208462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08651f36-e676-4e7b-ba17-29a2cf9d4080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a75cebf84bb4f5a8f23aa2172a68e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:25Z,use_quota=True,user_id='6f0f4f9a18f640d694f77778761858f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb8304a-c2d6-47be-9aec-b77e254c0904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb8304a-c2d6-47be-9aec-b77e254c0904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3727643b-3a5d-47de-a286-263cbdb7af55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3727643b-3a5d-47de-a286-263cbdb7af55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08651f36-e676-4e7b-ba17-29a2cf9d4080', 'volume_name': 'volume-08651f36-e676-4e7b-ba17-29a2cf9d4080', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a80f805-c39c-4c48-bb4b-9875faede0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a80f805-c39c-4c48-bb4b-9875faede0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cda95a-5ead-426f-be29-1ce2dc56c728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:25 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Volume 08651f36-e676-4e7b-ba17-29a2cf9d4080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08651f36-e676-4e7b-ba17-29a2cf9d4080', 'volume_size': 1} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Flow 'volume_create_manager' (7ace9d8e-eafb-407f-a9fe-57ab3d0034ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ee1b0a-b45d-4a47-ad44-91dea33e14fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ee1b0a-b45d-4a47-ad44-91dea33e14fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1890585830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e930e4b-d84d-44ac-8ca1-65cc13a2a981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a3f9a50915468d8413c08928027bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:25Z,use_quota=True,user_id='773dd35fe34b4cbab6d3c560bd39ed33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ede4264-1e62-49cd-abe1-0b6b6184be2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ede4264-1e62-49cd-abe1-0b6b6184be2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d87254-8da4-4e0e-b06e-e9c202688d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d87254-8da4-4e0e-b06e-e9c202688d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e930e4b-d84d-44ac-8ca1-65cc13a2a981', 'volume_name': 'volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79c8db1-2d4e-4d3b-a9b1-1193785e2d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79c8db1-2d4e-4d3b-a9b1-1193785e2d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd25c84-faa5-425b-be3a-34e515c9c243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:25 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Volume 3e930e4b-d84d-44ac-8ca1-65cc13a2a981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981', 'volume_size': 1} Jun 19 04:20:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:29 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb" returned: 0 in 5.474s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:30 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[60338779-ade1-4ec5-a311-b95d690fd2c8]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:30 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 Jun 19 04:20:30 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:30 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8" returned: 0 in 0.880s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:30 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:20:30 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Converted 1024.00 MB image at 187.02 MB/s Jun 19 04:20:30 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb is being set with open permissions: ugo+rw Jun 19 04:20:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:30 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb Jun 19 04:20:30 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:31 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb" returned: 0 in 0.675s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Lock "cinder-quobyte-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb" released by "_copy_volume_from_snapshot" :: held 8.877s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Acquiring lock "cinder-quobyte-83440b6b-c594-41b7-9531-94dcbb85c1e0" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Lock "cinder-quobyte-83440b6b-c594-41b7-9531-94dcbb85c1e0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Deleting offline snapshot 83440b6b-c594-41b7-9531-94dcbb85c1e0 of volume 0f700e8e-1a78-4bee-b280-ec44b16b96f8 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:20:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] snapshot_file for this snap is: volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:20:31 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[298ed205-8826-4601-a2a3-15528d6d7bab]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:31 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 Jun 19 04:20:31 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:32 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0" returned: 0 in 0.763s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:20:32 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf8852a-c5c7-4c1f-bc7f-4d18b5c930a3]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:32 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 Jun 19 04:20:32 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:33 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8" returned: 0 in 0.882s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:33 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 Jun 19 04:20:33 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:34 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0" returned: 0 in 0.868s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:34 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0 Jun 19 04:20:34 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:34 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8.83440b6b-c594-41b7-9531-94dcbb85c1e0" returned: 0 in 0.674s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Lock "cinder-quobyte-83440b6b-c594-41b7-9531-94dcbb85c1e0" released by "_delete_snapshot" :: held 3.287s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.751s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.738s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-618208462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08651f36-e676-4e7b-ba17-29a2cf9d4080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a75cebf84bb4f5a8f23aa2172a68e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:25Z,use_quota=True,user_id='6f0f4f9a18f640d694f77778761858f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Creating volume 08651f36-e676-4e7b-ba17-29a2cf9d4080 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:34 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:34 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 1073741824 Jun 19 04:20:34 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7cf8c57-503c-4df2-8043-bc065754ab90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb', 'volume_size': 2, 'source_volid': '0f700e8e-1a78-4bee-b280-ec44b16b96f8', 'source_volstatus': 'available'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb7c61f-d66e-4b41-acb3-31fce2423fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:35 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Volume volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb (2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb): created successfully Jun 19 04:20:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb7c61f-d66e-4b41-acb3-31fce2423fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Flow 'volume_create_manager' (0071051f-e851-41a2-aace-6515d4ff8df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:35 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-50291f64-4bd7-449b-9716-f42a645a482d tempest-VolumesCloneTest-1523761031 None] Created volume successfully. Jun 19 04:20:35 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Acquiring lock "cinder-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:35 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Lock "cinder-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:35 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Acquiring lock "cinder-quobyte-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:35 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Lock "cinder-quobyte-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:35 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d068924-8450-4015-8b9e-2a4842bada6a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:35 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb Jun 19 04:20:35 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:35 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 1073741824" returned: 0 in 0.940s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:35 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 Jun 19 04:20:35 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:36 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb" returned: 0 in 0.860s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:36 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb Jun 19 04:20:36 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:36 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080" returned: 0 in 0.793s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.310s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1890585830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e930e4b-d84d-44ac-8ca1-65cc13a2a981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a3f9a50915468d8413c08928027bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:25Z,use_quota=True,user_id='773dd35fe34b4cbab6d3c560bd39ed33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Creating volume 3e930e4b-d84d-44ac-8ca1-65cc13a2a981 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:36 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cda95a-5ead-426f-be29-1ce2dc56c728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08651f36-e676-4e7b-ba17-29a2cf9d4080', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:36 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 1073741824 Jun 19 04:20:36 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45399dd6-9932-4e3b-ad27-e2c97e84a633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:36 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Volume volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 (08651f36-e676-4e7b-ba17-29a2cf9d4080): created successfully Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45399dd6-9932-4e3b-ad27-e2c97e84a633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Flow 'volume_create_manager' (4a5c84c9-d53e-417c-80b8-c1daea6f28ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:36 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-901857ec-7d68-49ab-8347-b49eb9489fa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Created volume successfully. Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:37 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb" returned: 0 in 0.808s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Lock "cinder-quobyte-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb" released by "delete_volume" :: held 1.714s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Created reservations ['1d8c9fb1-7351-40b3-8513-056a1825b334', '76a03aab-5682-47f8-a694-1476ecbdc5cd', '35c1bee5-77b7-4f24-b6c1-42a40b53be56', 'e91af166-0504-40cd-bc76-3a2442ca673d'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:37 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:20:37 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:37 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 1073741824" returned: 0 in 0.967s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:37 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 Jun 19 04:20:37 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Acquiring lock "cinder-0f700e8e-1a78-4bee-b280-ec44b16b96f8-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:37 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Lock "cinder-0f700e8e-1a78-4bee-b280-ec44b16b96f8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Acquiring lock "cinder-quobyte-0f700e8e-1a78-4bee-b280-ec44b16b96f8" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Lock "cinder-quobyte-0f700e8e-1a78-4bee-b280-ec44b16b96f8" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[474eb9d7-c6a9-4c82-8d34-f77bf4e5868f]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:38 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 Jun 19 04:20:38 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:38 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.767s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:38 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Deleted volume successfully. Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-77152690-00b0-4543-a830-7c91e9e61e05 tempest-VolumesCloneTest-1523761031 None] Lock "cinder-2d1bec5b-7b5b-4fc7-b510-7f3cd46cafdb-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:38 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981" returned: 0 in 0.737s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.084s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd25c84-faa5-425b-be3a-34e515c9c243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21eba0ba-3d85-41a2-b397-c552c4ed01b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Creating offline snapshot daba2ce9-4881-41f9-b76d-8e1bbf7d35ce of volume 08651f36-e676-4e7b-ba17-29a2cf9d4080 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:20:38 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Volume volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 (3e930e4b-d84d-44ac-8ca1-65cc13a2a981): created successfully Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21eba0ba-3d85-41a2-b397-c552c4ed01b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Flow 'volume_create_manager' (7ace9d8e-eafb-407f-a9fe-57ab3d0034ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[58eba5e4-4f3e-402e-b747-87e9a1ac0153]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:38 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-107f7096-3219-449e-a2ac-7b653c74bfa2 req-f8c848f3-52a2-4043-98ce-6f985268d144 tempest-VolumesSnapshotsTestJSON-102611137 None] Created volume successfully. Jun 19 04:20:38 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 Jun 19 04:20:38 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:38 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8" returned: 0 in 0.872s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:38 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8 Jun 19 04:20:38 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:39 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080" returned: 0 in 0.889s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:39 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce 1G Jun 19 04:20:39 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:39 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0f700e8e-1a78-4bee-b280-ec44b16b96f8" returned: 0 in 0.710s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Lock "cinder-quobyte-0f700e8e-1a78-4bee-b280-ec44b16b96f8" released by "delete_volume" :: held 1.643s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:39 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Created reservations ['b174fc6c-d12c-4040-a471-e75dba3b0695', 'c644ab96-3111-4fe1-9359-a67710bbf28e', '1f206899-543f-4ba3-b479-09f71c7847a4', 'd61791a7-6f83-48a9-8ca8-524909824f23'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:39 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:20:39 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:40 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce 1G" returned: 0 in 0.908s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:40 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce Jun 19 04:20:40 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:40 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.746s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:40 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:40 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Deleted volume successfully. Jun 19 04:20:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-226945a5-6714-4395-b1eb-6c4b85c7ae6d tempest-VolumesCloneTest-1523761031 None] Lock "cinder-0f700e8e-1a78-4bee-b280-ec44b16b96f8-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:41 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce" returned: 0 in 0.835s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:41 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce is being set with open permissions: ugo+rw Jun 19 04:20:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:41 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce Jun 19 04:20:41 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:42 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce" returned: 0 in 0.869s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:42 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.info Jun 19 04:20:42 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:42 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.info" returned: 0 in 0.812s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:42 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.info is being set with open permissions: ugo+rw Jun 19 04:20:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:42 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.info Jun 19 04:20:42 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:43 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.info" returned: 0 in 0.872s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.339s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.711s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:43 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-aa3f9f57-ca31-4c0b-9e21-c06b64b4bb42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Create snapshot completed successfully Jun 19 04:20:43 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Flow 'volume_create_manager' (60ce4b1d-a691-4d8f-9d35-510dc43e3d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3d38a5-0003-4406-bfdf-2fbf581c526f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:43 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] Creating offline snapshot ef2047ca-9617-4bac-98fd-8f4750c76770 of volume 3e930e4b-d84d-44ac-8ca1-65cc13a2a981 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:20:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3d38a5-0003-4406-bfdf-2fbf581c526f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-183226933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c2ae55-d198-4d1c-92a2-574016d5b628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9aba07b1e74becb2feb651514e1145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:44Z,use_quota=True,user_id='c887bb6dfad54865bfc1d311ee7a86e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7b6e0f-dcc0-402c-a3cd-3134cc2f16fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7b6e0f-dcc0-402c-a3cd-3134cc2f16fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d843f2-5bac-4f32-a776-ee916f7ab694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d843f2-5bac-4f32-a776-ee916f7ab694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c2ae55-d198-4d1c-92a2-574016d5b628', 'volume_name': 'volume-d3c2ae55-d198-4d1c-92a2-574016d5b628', 'volume_size': 2}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7469460b-dfd3-4cb7-931b-f3c946e91116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7469460b-dfd3-4cb7-931b-f3c946e91116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdae348f-cd03-4f67-9489-e4265fc2e409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:44 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Volume d3c2ae55-d198-4d1c-92a2-574016d5b628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c2ae55-d198-4d1c-92a2-574016d5b628', 'volume_size': 2} Jun 19 04:20:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:44 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2288f0a5-aa75-49b4-8ec6-987a6efc294b]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:44 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 Jun 19 04:20:44 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:44 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981" returned: 0 in 0.777s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:44 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 1G Jun 19 04:20:44 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Acquiring lock "cinder-daba2ce9-4881-41f9-b76d-8e1bbf7d35ce-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "cinder-daba2ce9-4881-41f9-b76d-8e1bbf7d35ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Acquiring lock "cinder-quobyte-08651f36-e676-4e7b-ba17-29a2cf9d4080" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "cinder-quobyte-08651f36-e676-4e7b-ba17-29a2cf9d4080" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Acquiring lock "cinder-quobyte-daba2ce9-4881-41f9-b76d-8e1bbf7d35ce" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "cinder-quobyte-daba2ce9-4881-41f9-b76d-8e1bbf7d35ce" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Deleting offline snapshot daba2ce9-4881-41f9-b76d-8e1bbf7d35ce of volume 08651f36-e676-4e7b-ba17-29a2cf9d4080 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:20:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] snapshot_file for this snap is: volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:20:45 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[66769b08-853f-4793-91f8-ae1fe0586024]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:45 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce Jun 19 04:20:45 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:45 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 1G" returned: 0 in 0.884s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:45 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 Jun 19 04:20:45 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:46 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce" returned: 0 in 0.857s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08651f36-e676-4e7b-ba17-29a2cf9d4080(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:20:46 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[201bf3ea-e976-4d13-817b-0b4e3bfbaf15]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:46 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 Jun 19 04:20:46 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:46 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770" returned: 0 in 0.721s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:46 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 is being set with open permissions: ugo+rw Jun 19 04:20:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:46 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 Jun 19 04:20:46 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:47 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080" returned: 0 in 0.808s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:47 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770" returned: 0 in 0.669s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:47 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce Jun 19 04:20:47 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:47 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.info Jun 19 04:20:47 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:47 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.info" returned: 0 in 0.668s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:47 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.info is being set with open permissions: ugo+rw Jun 19 04:20:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:47 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.info Jun 19 04:20:47 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:47 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce" returned: 0 in 0.762s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:47 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce Jun 19 04:20:47 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:48 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.info" returned: 0 in 0.651s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.616s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.445s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-183226933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c2ae55-d198-4d1c-92a2-574016d5b628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9aba07b1e74becb2feb651514e1145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:44Z,use_quota=True,user_id='c887bb6dfad54865bfc1d311ee7a86e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Creating volume d3c2ae55-d198-4d1c-92a2-574016d5b628 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:48 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d3c2ae55-d198-4d1c-92a2-574016d5b628 2147483648 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:48 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d3c2ae55-d198-4d1c-92a2-574016d5b628 2147483648 Jun 19 04:20:48 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:48 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-7fdc13a0-f5d3-4dc5-8104-153a2d156adb req-f3e43cea-1ca1-4677-a11d-15637f648c99 tempest-VolumesSnapshotsTestJSON-102611137 None] Create snapshot completed successfully Jun 19 04:20:48 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080.daba2ce9-4881-41f9-b76d-8e1bbf7d35ce" returned: 0 in 0.747s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "cinder-quobyte-daba2ce9-4881-41f9-b76d-8e1bbf7d35ce" released by "_delete_snapshot" :: held 3.295s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "cinder-quobyte-08651f36-e676-4e7b-ba17-29a2cf9d4080" released by "delete_snapshot" :: held 3.324s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Created reservations ['d6fbd453-bb71-4e98-871a-4f9195497445', 'be3ce054-4b7d-4c77-9f2f-e81a15144060', '62b62642-0ed0-4669-9f71-a848620ca177', '5d6f9d46-d576-4643-a51c-94a7668edc5e'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:48 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Delete snapshot completed successfully. Jun 19 04:20:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2083954e-0508-49d7-8eba-02f6f30b9898 tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "cinder-daba2ce9-4881-41f9-b76d-8e1bbf7d35ce-delete_snapshot" released by "delete_snapshot" :: held 3.652s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Acquiring lock "cinder-ef2047ca-9617-4bac-98fd-8f4750c76770-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "cinder-ef2047ca-9617-4bac-98fd-8f4750c76770-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Acquiring lock "cinder-quobyte-3e930e4b-d84d-44ac-8ca1-65cc13a2a981" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "cinder-quobyte-3e930e4b-d84d-44ac-8ca1-65cc13a2a981" acquired by "delete_snapshot" :: waited 0.059s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Acquiring lock "cinder-quobyte-ef2047ca-9617-4bac-98fd-8f4750c76770" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "cinder-quobyte-ef2047ca-9617-4bac-98fd-8f4750c76770" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Deleting offline snapshot ef2047ca-9617-4bac-98fd-8f4750c76770 of volume 3e930e4b-d84d-44ac-8ca1-65cc13a2a981 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] snapshot_file for this snap is: volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93a1845-a9af-4053-b646-58f631c5fd4a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:49 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 Jun 19 04:20:49 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Acquiring lock "cinder-08651f36-e676-4e7b-ba17-29a2cf9d4080-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "cinder-08651f36-e676-4e7b-ba17-29a2cf9d4080-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Acquiring lock "cinder-quobyte-08651f36-e676-4e7b-ba17-29a2cf9d4080" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "cinder-quobyte-08651f36-e676-4e7b-ba17-29a2cf9d4080" acquired by "delete_volume" :: waited 0.031s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:50 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[76637611-e092-4cc6-90a5-892ec27ae47d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:50 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 Jun 19 04:20:50 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:50 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d3c2ae55-d198-4d1c-92a2-574016d5b628 2147483648" returned: 0 in 1.948s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d3c2ae55-d198-4d1c-92a2-574016d5b628 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:50 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d3c2ae55-d198-4d1c-92a2-574016d5b628 Jun 19 04:20:50 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:50 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770" returned: 0 in 1.505s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:20:50 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c01d78f-66c6-416c-9674-d797b30926aa]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:51 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 Jun 19 04:20:51 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:51 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080" returned: 0 in 1.329s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:51 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080 Jun 19 04:20:51 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:51 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d3c2ae55-d198-4d1c-92a2-574016d5b628" returned: 0 in 1.019s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] <== create_volume: return (3052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.056s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdae348f-cd03-4f67-9489-e4265fc2e409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c2ae55-d198-4d1c-92a2-574016d5b628', 'volume_size': 2}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67098488-f040-462a-bae5-22508af04b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:51 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Volume volume-d3c2ae55-d198-4d1c-92a2-574016d5b628 (d3c2ae55-d198-4d1c-92a2-574016d5b628): created successfully Jun 19 04:20:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67098488-f040-462a-bae5-22508af04b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Flow 'volume_create_manager' (60ce4b1d-a691-4d8f-9d35-510dc43e3d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:51 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-13b25741-fcf0-4b69-ba2f-1d53d6cbc285 tempest-VolumesCloneNegativeTest-1618919017 None] Created volume successfully. Jun 19 04:20:52 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981" returned: 0 in 1.056s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:52 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 Jun 19 04:20:52 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:52 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-08651f36-e676-4e7b-ba17-29a2cf9d4080" returned: 0 in 1.236s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "cinder-quobyte-08651f36-e676-4e7b-ba17-29a2cf9d4080" released by "delete_volume" :: held 2.668s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:52 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Created reservations ['13aab919-abda-4deb-92c8-bc60a6efd343', '54f928f5-eef0-448b-aa97-167c39d15fe8', '5c02fd0c-6672-4a00-b5be-1c2aabe8bad7', '47395bd1-9d53-46c8-8fc7-2e9acc192c66'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:52 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:20:52 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Acquiring lock "cinder-d3c2ae55-d198-4d1c-92a2-574016d5b628-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Lock "cinder-d3c2ae55-d198-4d1c-92a2-574016d5b628-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Acquiring lock "cinder-quobyte-d3c2ae55-d198-4d1c-92a2-574016d5b628" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Lock "cinder-quobyte-d3c2ae55-d198-4d1c-92a2-574016d5b628" acquired by "delete_volume" :: waited 0.038s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:53 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2862d5d0-49f1-441b-92f4-089c379a54a1]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d3c2ae55-d198-4d1c-92a2-574016d5b628 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:53 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d3c2ae55-d198-4d1c-92a2-574016d5b628 Jun 19 04:20:53 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:53 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770" returned: 0 in 1.483s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:53 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770 Jun 19 04:20:53 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:53 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.963s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:53 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:53 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Deleted volume successfully. Jun 19 04:20:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8fdf3ec1-1d7b-4bec-95b7-ccb14f7b7cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1267080071 None] Lock "cinder-08651f36-e676-4e7b-ba17-29a2cf9d4080-delete_volume" released by "delete_volume" :: held 4.059s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:54 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981.ef2047ca-9617-4bac-98fd-8f4750c76770" returned: 0 in 1.215s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "cinder-quobyte-ef2047ca-9617-4bac-98fd-8f4750c76770" released by "_delete_snapshot" :: held 5.452s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:54 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d3c2ae55-d198-4d1c-92a2-574016d5b628" returned: 0 in 1.584s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d3c2ae55-d198-4d1c-92a2-574016d5b628 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "cinder-quobyte-3e930e4b-d84d-44ac-8ca1-65cc13a2a981" released by "delete_snapshot" :: held 5.510s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:54 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d3c2ae55-d198-4d1c-92a2-574016d5b628 Jun 19 04:20:54 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:54 devstack cinder-volume[93300]: DEBUG cinder.quota [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Created reservations ['76228d90-8f2a-4734-986d-6ce5e338d158', '72debcd1-58bd-4b00-a131-457f44553110', '51b55c66-d9d8-4ace-8320-704f086928cd', '41e00f81-0d25-45bb-8ffb-45f5854591bd'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:55 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Delete snapshot completed successfully. Jun 19 04:20:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-57f746b6-a2d7-4650-8c03-cf8e7fe2f317 req-f70a6721-91d5-4025-a11a-d69d155ce7d2 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "cinder-ef2047ca-9617-4bac-98fd-8f4750c76770-delete_snapshot" released by "delete_snapshot" :: held 5.861s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:55 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d3c2ae55-d198-4d1c-92a2-574016d5b628" returned: 0 in 0.973s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Lock "cinder-quobyte-d3c2ae55-d198-4d1c-92a2-574016d5b628" released by "delete_volume" :: held 2.621s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:55 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Created reservations ['185e0389-7dc0-423b-8760-764bdc631be3', '8153415a-5449-485f-8a69-5ff1c3e8de8e', '219514ef-3f0d-479f-8bf1-9bb53e390e61', 'b55cb5cc-3578-4484-9d45-43f9bc28c780'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:56 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:20:56 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Acquiring lock "cinder-3e930e4b-d84d-44ac-8ca1-65cc13a2a981-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "cinder-3e930e4b-d84d-44ac-8ca1-65cc13a2a981-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Acquiring lock "cinder-quobyte-3e930e4b-d84d-44ac-8ca1-65cc13a2a981" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "cinder-quobyte-3e930e4b-d84d-44ac-8ca1-65cc13a2a981" acquired by "delete_volume" :: waited 0.048s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:56 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d6dd5c-8361-4115-b830-62d9cf6fc808]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:56 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 Jun 19 04:20:56 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:57 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.184s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:57 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:57 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Deleted volume successfully. Jun 19 04:20:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76d2276b-820f-4b94-af6b-27e025f4c609 tempest-VolumesCloneNegativeTest-1618919017 None] Lock "cinder-d3c2ae55-d198-4d1c-92a2-574016d5b628-delete_volume" released by "delete_volume" :: held 4.237s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:57 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981" returned: 0 in 1.318s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:57 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981 Jun 19 04:20:57 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:58 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3e930e4b-d84d-44ac-8ca1-65cc13a2a981" returned: 0 in 1.045s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "cinder-quobyte-3e930e4b-d84d-44ac-8ca1-65cc13a2a981" released by "delete_volume" :: held 2.518s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:59 devstack cinder-volume[93300]: DEBUG cinder.quota [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Created reservations ['0c57567c-7be2-41da-a09b-2a8e966e33c0', 'ffa63cf6-90b2-4066-8d20-e195557a7dca', 'd95a044c-51ee-44fb-9062-aea0549da015', '7c972346-a678-4fa2-84c4-23e59c02f808'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:59 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:20:59 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:00 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.017s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:00 devstack cinder-volume[93300]: DEBUG cinder.manager [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:00 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Deleted volume successfully. Jun 19 04:21:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-78925d18-f1e7-453d-928d-d588aaf00c61 req-622422a3-f829-48be-ac3e-1e55a3675459 tempest-VolumesSnapshotsTestJSON-102611137 None] Lock "cinder-3e930e4b-d84d-44ac-8ca1-65cc13a2a981-delete_volume" released by "delete_volume" :: held 3.905s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Flow 'volume_create_manager' (97e05c3c-09d5-498c-ab92-5cd7e84a84ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21de249f-8f9a-4136-ade8-e7b0c35ab5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21de249f-8f9a-4136-ade8-e7b0c35ab5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1636021220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da46ac52-26f8-4fe2-85d1-1a659a39cf64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd4189af7eb46e49baaad70bd92c3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:03Z,use_quota=True,user_id='91ce62e7217f440982d7129490b71fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e08b296b-9af4-409e-ae0f-d425b9c29cc1),volume_type_id=e08b296b-9af4-409e-ae0f-d425b9c29cc1)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002fa95c-2e6f-4f28-80e5-8ec90fa86013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002fa95c-2e6f-4f28-80e5-8ec90fa86013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5694f5-06ea-4317-a6e3-0cd623cdec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5694f5-06ea-4317-a6e3-0cd623cdec35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da46ac52-26f8-4fe2-85d1-1a659a39cf64', 'volume_name': 'volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf41026-3857-4d7d-ad84-4515c9824ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf41026-3857-4d7d-ad84-4515c9824ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8775be0e-9da4-4375-bf19-c4f2f220103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:03 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Volume da46ac52-26f8-4fe2-85d1-1a659a39cf64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64', 'volume_size': 1} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1636021220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da46ac52-26f8-4fe2-85d1-1a659a39cf64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd4189af7eb46e49baaad70bd92c3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:03Z,use_quota=True,user_id='91ce62e7217f440982d7129490b71fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e08b296b-9af4-409e-ae0f-d425b9c29cc1),volume_type_id=e08b296b-9af4-409e-ae0f-d425b9c29cc1)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Creating volume da46ac52-26f8-4fe2-85d1-1a659a39cf64 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:03 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:21:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:03 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64 1073741824 Jun 19 04:21:03 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:04 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64 1073741824" returned: 0 in 0.988s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:04 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64 Jun 19 04:21:04 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:05 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64" returned: 0 in 0.757s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8775be0e-9da4-4375-bf19-c4f2f220103e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7608a1b-1bdd-4a8d-a903-c41325d954de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:05 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Volume volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64 (da46ac52-26f8-4fe2-85d1-1a659a39cf64): created successfully Jun 19 04:21:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7608a1b-1bdd-4a8d-a903-c41325d954de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Flow 'volume_create_manager' (97e05c3c-09d5-498c-ab92-5cd7e84a84ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:05 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f3494768-c0c8-4f69-bd8f-48790e94e058 tempest-VolumeTypesAccessTest-1084698226 None] Created volume successfully. Jun 19 04:21:06 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-5b2921d5-7a3c-4ddc-84bd-6c8b3e24698b tempest-GroupsTest-778167705 None] Group tempest-Group1-1044652726: creating Jun 19 04:21:06 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-5b2921d5-7a3c-4ddc-84bd-6c8b3e24698b tempest-GroupsTest-778167705 None] Group tempest-Group1-1044652726: created successfully Jun 19 04:21:06 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-5b2921d5-7a3c-4ddc-84bd-6c8b3e24698b tempest-GroupsTest-778167705 None] Create group completed successfully. Jun 19 04:21:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Acquiring lock "cinder-da46ac52-26f8-4fe2-85d1-1a659a39cf64-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Lock "cinder-da46ac52-26f8-4fe2-85d1-1a659a39cf64-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Acquiring lock "cinder-quobyte-da46ac52-26f8-4fe2-85d1-1a659a39cf64" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Lock "cinder-quobyte-da46ac52-26f8-4fe2-85d1-1a659a39cf64" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:06 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[934ef69c-5827-4d9f-8fd4-8c8b3a6e54bd]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:07 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64 Jun 19 04:21:07 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:07 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3bf4f8b1-1178-4948-b906-027a4744c634 tempest-GroupsTest-778167705 None] Group tempest-Group2-1647679201: creating Jun 19 04:21:07 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3bf4f8b1-1178-4948-b906-027a4744c634 tempest-GroupsTest-778167705 None] Group tempest-Group2-1647679201: created successfully Jun 19 04:21:07 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3bf4f8b1-1178-4948-b906-027a4744c634 tempest-GroupsTest-778167705 None] Create group completed successfully. Jun 19 04:21:07 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64" returned: 0 in 0.973s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:07 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64 Jun 19 04:21:07 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:08 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da46ac52-26f8-4fe2-85d1-1a659a39cf64" returned: 0 in 0.691s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Lock "cinder-quobyte-da46ac52-26f8-4fe2-85d1-1a659a39cf64" released by "delete_volume" :: held 1.718s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:08 devstack cinder-volume[93300]: WARNING cinder.quota [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1401617250 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1401617250, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:21:08 devstack cinder-volume[93300]: WARNING cinder.quota [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1401617250 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1401617250, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:21:08 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Created reservations ['d28b01e5-e342-4e07-a542-39563ff4af37', 'a0311138-86c7-4ffd-8349-9cfac1c047e8', 'f3476fab-bb00-473c-8a71-ceb42c066f41', 'a20cfccc-c4ec-4c70-8798-d56ad0872ce9'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:08 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:08 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:08 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:21:08 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Flow 'volume_create_manager' (1690fa02-f463-4a0f-ad90-a8a3a9e55805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7a4e1e-c913-4a1b-a0e6-731e94d6bc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7a4e1e-c913-4a1b-a0e6-731e94d6bc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-60386920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9f08b1d-a731-48db-8a23-33b866f1f408,host='devstack@QuobyteHD#QuobyteHD',id=3f1a838b-1f43-49bb-8799-47933ae18e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf11a563fe4c403fade9db763d279024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:09Z,use_quota=True,user_id='6d13cee8299a4a6d8ad92c7f1dcfd3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61c118aa-35e3-460d-9b59-a3586d3ed361),volume_type_id=61c118aa-35e3-460d-9b59-a3586d3ed361)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f13653-9622-4b11-8909-2659d4ee13f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f13653-9622-4b11-8909-2659d4ee13f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b24f797-e4e5-4e8c-bc6f-2e36f62ed204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b24f797-e4e5-4e8c-bc6f-2e36f62ed204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1a838b-1f43-49bb-8799-47933ae18e88', 'volume_name': 'volume-3f1a838b-1f43-49bb-8799-47933ae18e88', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24fdf681-4c90-4e53-86af-c54951c1f53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24fdf681-4c90-4e53-86af-c54951c1f53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae47a11-dae6-4952-859f-a693d458e60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:09 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Volume 3f1a838b-1f43-49bb-8799-47933ae18e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1a838b-1f43-49bb-8799-47933ae18e88', 'volume_size': 1} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e9f08b1d-a731-48db-8a23-33b866f1f408,created_at=2026-06-19T02:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-60386920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9f08b1d-a731-48db-8a23-33b866f1f408,host='devstack@QuobyteHD#QuobyteHD',id=3f1a838b-1f43-49bb-8799-47933ae18e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf11a563fe4c403fade9db763d279024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:09Z,use_quota=True,user_id='6d13cee8299a4a6d8ad92c7f1dcfd3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61c118aa-35e3-460d-9b59-a3586d3ed361),volume_type_id=61c118aa-35e3-460d-9b59-a3586d3ed361)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Creating volume 3f1a838b-1f43-49bb-8799-47933ae18e88 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:09 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3f1a838b-1f43-49bb-8799-47933ae18e88 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:09 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3f1a838b-1f43-49bb-8799-47933ae18e88 1073741824 Jun 19 04:21:09 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:09 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.200s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:09 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:09 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Deleted volume successfully. Jun 19 04:21:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e21b6bc2-23f1-4928-a0f8-e01058e5f9e1 tempest-VolumeTypesAccessTest-1084698226 None] Lock "cinder-da46ac52-26f8-4fe2-85d1-1a659a39cf64-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:10 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3f1a838b-1f43-49bb-8799-47933ae18e88 1073741824" returned: 0 in 1.339s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3f1a838b-1f43-49bb-8799-47933ae18e88 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:10 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3f1a838b-1f43-49bb-8799-47933ae18e88 Jun 19 04:21:10 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:11 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3f1a838b-1f43-49bb-8799-47933ae18e88" returned: 0 in 1.104s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] <== create_volume: return (2523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.525s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:11 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae47a11-dae6-4952-859f-a693d458e60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1a838b-1f43-49bb-8799-47933ae18e88', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:11 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064a4eeb-e7df-408b-93ec-f0cfa1cb7dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:12 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Volume volume-3f1a838b-1f43-49bb-8799-47933ae18e88 (3f1a838b-1f43-49bb-8799-47933ae18e88): created successfully Jun 19 04:21:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064a4eeb-e7df-408b-93ec-f0cfa1cb7dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Flow 'volume_create_manager' (1690fa02-f463-4a0f-ad90-a8a3a9e55805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:12 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-fdc8e0f6-2d05-4bdf-8aa1-18f2105f873b tempest-GroupsTest-778167705 None] Created volume successfully. Jun 19 04:21:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Acquiring lock "cinder-quobyte-3f1a838b-1f43-49bb-8799-47933ae18e88" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Lock "cinder-quobyte-3f1a838b-1f43-49bb-8799-47933ae18e88" acquired by "delete_volume" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:13 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4069f41b-cec7-4941-a537-22dfde3cd3da]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3f1a838b-1f43-49bb-8799-47933ae18e88 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:14 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3f1a838b-1f43-49bb-8799-47933ae18e88 Jun 19 04:21:14 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Flow 'volume_create_manager' (0fe9ac26-a632-45a1-9fe1-817801339ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f18a78-3451-4f95-8514-4161873bb147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f18a78-3451-4f95-8514-4161873bb147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1908680953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93c3549-8cd3-4194-a5bb-25e928a9b332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167294a48f504a8f96854d34e8ccc869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:15Z,use_quota=True,user_id='02cd0944a56a4a44a1a38a3f2820167d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956ed378-8d5f-4c8d-8f06-b479d8725e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956ed378-8d5f-4c8d-8f06-b479d8725e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65ccdfb-e70c-44e2-b885-2e6a45351bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65ccdfb-e70c-44e2-b885-2e6a45351bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a93c3549-8cd3-4194-a5bb-25e928a9b332', 'volume_name': 'volume-a93c3549-8cd3-4194-a5bb-25e928a9b332', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e51e98-2375-42d5-a5ba-bba12e1a3967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e51e98-2375-42d5-a5ba-bba12e1a3967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c878a23-967e-41c8-9a75-2f06a6cf9d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:14 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Volume a93c3549-8cd3-4194-a5bb-25e928a9b332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a93c3549-8cd3-4194-a5bb-25e928a9b332', 'volume_size': 1} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1908680953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93c3549-8cd3-4194-a5bb-25e928a9b332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167294a48f504a8f96854d34e8ccc869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:15Z,use_quota=True,user_id='02cd0944a56a4a44a1a38a3f2820167d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Creating volume a93c3549-8cd3-4194-a5bb-25e928a9b332 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:14 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:14 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 1073741824 Jun 19 04:21:14 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:14 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3f1a838b-1f43-49bb-8799-47933ae18e88" returned: 0 in 0.981s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3f1a838b-1f43-49bb-8799-47933ae18e88 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:14 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3f1a838b-1f43-49bb-8799-47933ae18e88 Jun 19 04:21:14 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Flow 'volume_create_manager' (fe376571-5e3b-4462-92b0-c43855fd6f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c0ca001-2d04-4861-8a71-5ae273af622e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c0ca001-2d04-4861-8a71-5ae273af622e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1391930054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9312afc-c26e-4077-9f53-fde230f819d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8898361393604a9f9c2c58a51f3aa60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:16Z,use_quota=True,user_id='8504b3e3f72b4a028b4f82464cdddc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f61a22-e2c3-498a-af1d-71cb2bbbb37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f61a22-e2c3-498a-af1d-71cb2bbbb37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (decc5700-dd28-41f2-b9c9-a49adb4fc10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (decc5700-dd28-41f2-b9c9-a49adb4fc10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9312afc-c26e-4077-9f53-fde230f819d8', 'volume_name': 'volume-d9312afc-c26e-4077-9f53-fde230f819d8', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030ac637-37ea-4987-a6cc-09ed5db7a219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:15 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030ac637-37ea-4987-a6cc-09ed5db7a219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbfa5f3-49d0-4515-a135-e885350dbe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:15 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Volume d9312afc-c26e-4077-9f53-fde230f819d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9312afc-c26e-4077-9f53-fde230f819d8', 'volume_size': 1} Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-3f1a838b-1f43-49bb-8799-47933ae18e88" returned: 0 in 0.941s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Lock "cinder-quobyte-3f1a838b-1f43-49bb-8799-47933ae18e88" released by "delete_volume" :: held 1.976s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:15 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Created reservations ['7ae83653-b79f-4d4e-b000-b3317537b1a9'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:15 devstack cinder-volume[93300]: WARNING cinder.quota [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-850312838 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-850312838, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:21:15 devstack cinder-volume[93300]: WARNING cinder.quota [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-850312838 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-850312838, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Created reservations ['3ba50efa-e0d7-4d0e-a349-678bfc104de6', '204d5171-eb6e-42eb-ba93-1ed6f07df8ae', '3f6e03b0-8004-4816-9891-95a74429f5fe', '15f0e715-7e1d-4e8b-b118-d00c6398c6ae'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:16 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 1073741824" returned: 0 in 1.148s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:16 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 Jun 19 04:21:16 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:16 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:21:16 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-3f997985-58f9-47ed-b29c-09a55a2a487d tempest-GroupsTest-778167705 None] Created reservations ['9f41ee9b-41c4-45dd-b4e4-ea2e6e858f4d'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3f997985-58f9-47ed-b29c-09a55a2a487d tempest-GroupsTest-778167705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3f997985-58f9-47ed-b29c-09a55a2a487d tempest-GroupsTest-778167705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3f997985-58f9-47ed-b29c-09a55a2a487d tempest-GroupsTest-778167705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3f997985-58f9-47ed-b29c-09a55a2a487d tempest-GroupsTest-778167705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3f997985-58f9-47ed-b29c-09a55a2a487d tempest-GroupsTest-778167705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3f997985-58f9-47ed-b29c-09a55a2a487d tempest-GroupsTest-778167705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:16 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:21:16 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:16 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332" returned: 0 in 0.891s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.081s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1391930054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9312afc-c26e-4077-9f53-fde230f819d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8898361393604a9f9c2c58a51f3aa60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:16Z,use_quota=True,user_id='8504b3e3f72b4a028b4f82464cdddc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Creating volume d9312afc-c26e-4077-9f53-fde230f819d8 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:16 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:21:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c878a23-967e-41c8-9a75-2f06a6cf9d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a93c3549-8cd3-4194-a5bb-25e928a9b332', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:17 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8 1073741824 Jun 19 04:21:17 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a2ea76-6408-4408-9c94-93f44c91cad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:17 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Volume volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 (a93c3549-8cd3-4194-a5bb-25e928a9b332): created successfully Jun 19 04:21:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a2ea76-6408-4408-9c94-93f44c91cad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Flow 'volume_create_manager' (0fe9ac26-a632-45a1-9fe1-817801339ca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:17 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4c044d8b-04b3-4d94-94c2-82a87cb97044 tempest-VolumesSnapshotTestJSON-1029927790 None] Created volume successfully. Jun 19 04:21:17 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.934s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:17 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:17 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-51d90a7f-5ae4-4069-a77b-675adcdfb4fd tempest-GroupsTest-778167705 None] Delete group completed successfully. Jun 19 04:21:17 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3f997985-58f9-47ed-b29c-09a55a2a487d tempest-GroupsTest-778167705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.706s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:17 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-3f997985-58f9-47ed-b29c-09a55a2a487d tempest-GroupsTest-778167705 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:17 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3f997985-58f9-47ed-b29c-09a55a2a487d tempest-GroupsTest-778167705 None] Delete group completed successfully. Jun 19 04:21:18 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8 1073741824" returned: 0 in 1.084s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:18 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8 Jun 19 04:21:18 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:18 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d10cee81-33c3-4f79-9c40-a26cd393460e tempest-GroupsTest-778167705 None] Group tempest-GroupsTest-Group-443136350: creating Jun 19 04:21:18 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d10cee81-33c3-4f79-9c40-a26cd393460e tempest-GroupsTest-778167705 None] Group tempest-GroupsTest-Group-443136350: created successfully Jun 19 04:21:18 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d10cee81-33c3-4f79-9c40-a26cd393460e tempest-GroupsTest-778167705 None] Create group completed successfully. Jun 19 04:21:18 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8" returned: 0 in 0.818s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.711s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] Creating offline snapshot 01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 of volume a93c3549-8cd3-4194-a5bb-25e928a9b332 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:21:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbfa5f3-49d0-4515-a135-e885350dbe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9312afc-c26e-4077-9f53-fde230f819d8', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0d1125-f5fe-4944-88f0-ff58cd6ffba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:18 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[014d7455-ddb4-486a-81cd-b212ca7e2705]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:18 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Volume volume-d9312afc-c26e-4077-9f53-fde230f819d8 (d9312afc-c26e-4077-9f53-fde230f819d8): created successfully Jun 19 04:21:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0d1125-f5fe-4944-88f0-ff58cd6ffba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Flow 'volume_create_manager' (fe376571-5e3b-4462-92b0-c43855fd6f1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:19 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-7a7bba34-a99c-4cca-bbbf-6e9dcd0b7207 tempest-AttachVolumeTestJSON-1314088858 None] Created volume successfully. Jun 19 04:21:19 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 Jun 19 04:21:19 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:21:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:19 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:21:19 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:19 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332" returned: 0 in 0.912s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:19 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 1G Jun 19 04:21:19 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:20 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.885s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 8 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Flow 'volume_create_manager' (3665f6eb-c1af-469e-812c-dbf56edf74da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa59a047-db28-4eab-96ab-1925fabff29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa59a047-db28-4eab-96ab-1925fabff29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-204649863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25cd6c4a-f66b-40fc-8be1-284b38d015de,host='devstack@QuobyteHD#QuobyteHD',id=30611da5-3d40-46bd-9fff-72d9db61778e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf11a563fe4c403fade9db763d279024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:20Z,use_quota=True,user_id='6d13cee8299a4a6d8ad92c7f1dcfd3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4aa539f5-2054-4e2f-871f-05c8422e4d8a),volume_type_id=4aa539f5-2054-4e2f-871f-05c8422e4d8a)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b093ffeb-2bf8-4653-ac9e-9b18dc432a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b093ffeb-2bf8-4653-ac9e-9b18dc432a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de15c51-8732-4eeb-afc9-cb9bb7466c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de15c51-8732-4eeb-afc9-cb9bb7466c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30611da5-3d40-46bd-9fff-72d9db61778e', 'volume_name': 'volume-30611da5-3d40-46bd-9fff-72d9db61778e', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74ad476-3a3e-482f-a782-0fa7c6b3dd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74ad476-3a3e-482f-a782-0fa7c6b3dd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13d6537-f8a0-4bb7-88a8-7c285ddad122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:20 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Volume 30611da5-3d40-46bd-9fff-72d9db61778e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30611da5-3d40-46bd-9fff-72d9db61778e', 'volume_size': 1} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:20 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 1G" returned: 0 in 1.067s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:20 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 Jun 19 04:21:20 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:21 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9" returned: 0 in 0.778s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:21 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 is being set with open permissions: ugo+rw Jun 19 04:21:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:21 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 Jun 19 04:21:21 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:22 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9" returned: 0 in 0.676s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:22 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=84,cinder:UPDATE=105,cinder:INSERT=22,cinder:DELETE=7 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:21:22 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=88,cinder:INSERT=27,cinder:UPDATE=103,cinder:DELETE=9 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:21:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:22 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.info Jun 19 04:21:22 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:23 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.info" returned: 0 in 0.691s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:23 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.info is being set with open permissions: ugo+rw Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:23 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.info Jun 19 04:21:23 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-a5794fbb-6aaa-40e5-b865-e472c0c7a0bc req-43bb217a-3b0e-4b30-bb76-09854d0d45e4 tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:23 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.info" returned: 0 in 0.691s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.942s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.538s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=25cd6c4a-f66b-40fc-8be1-284b38d015de,created_at=2026-06-19T02:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-204649863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25cd6c4a-f66b-40fc-8be1-284b38d015de,host='devstack@QuobyteHD#QuobyteHD',id=30611da5-3d40-46bd-9fff-72d9db61778e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf11a563fe4c403fade9db763d279024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:20Z,use_quota=True,user_id='6d13cee8299a4a6d8ad92c7f1dcfd3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4aa539f5-2054-4e2f-871f-05c8422e4d8a),volume_type_id=4aa539f5-2054-4e2f-871f-05c8422e4d8a)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Creating volume 30611da5-3d40-46bd-9fff-72d9db61778e {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:23 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:21:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-30611da5-3d40-46bd-9fff-72d9db61778e 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:23 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-30611da5-3d40-46bd-9fff-72d9db61778e 1073741824 Jun 19 04:21:23 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:23 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4305bbdd-0234-488f-8c6a-9165a77214ab tempest-VolumesSnapshotTestJSON-1029927790 None] Create snapshot completed successfully Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Flow 'volume_create_manager' (62d537fd-9ad2-4af9-8b6e-3e37e9f85b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e7b1ec-138b-49e1-bc1c-4d87a8eb8ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e7b1ec-138b-49e1-bc1c-4d87a8eb8ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1566674262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c40bcf6-3358-4864-bd93-20a89667ee4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de60639d4f8e44bf953c8331f9013d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:24Z,use_quota=True,user_id='3bf44df4963e490c8c9993636703434e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a83dea-e4d5-46b0-b94a-950be9ae0b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a83dea-e4d5-46b0-b94a-950be9ae0b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7c1df1-1a84-4df7-b2dd-fee01a982bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7c1df1-1a84-4df7-b2dd-fee01a982bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c40bcf6-3358-4864-bd93-20a89667ee4f', 'volume_name': 'volume-9c40bcf6-3358-4864-bd93-20a89667ee4f', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d90d59-e98f-451f-9998-072c7cda0036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d90d59-e98f-451f-9998-072c7cda0036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b87a283-c8ec-42d4-9f7b-25ccdb226d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:24 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Volume 9c40bcf6-3358-4864-bd93-20a89667ee4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c40bcf6-3358-4864-bd93-20a89667ee4f', 'volume_size': 1} Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:24 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-30611da5-3d40-46bd-9fff-72d9db61778e 1073741824" returned: 0 in 0.898s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-30611da5-3d40-46bd-9fff-72d9db61778e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:24 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-30611da5-3d40-46bd-9fff-72d9db61778e Jun 19 04:21:24 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-01a5ef6b-7b81-4925-8b1a-2be0b1b173d9-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-01a5ef6b-7b81-4925-8b1a-2be0b1b173d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-a93c3549-8cd3-4194-a5bb-25e928a9b332" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-a93c3549-8cd3-4194-a5bb-25e928a9b332" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-01a5ef6b-7b81-4925-8b1a-2be0b1b173d9" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-01a5ef6b-7b81-4925-8b1a-2be0b1b173d9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Deleting offline snapshot 01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 of volume a93c3549-8cd3-4194-a5bb-25e928a9b332 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] snapshot_file for this snap is: volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60d46e8-1c30-44ec-8dc4-92d9812e73cd]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:25 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 Jun 19 04:21:25 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:25 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-30611da5-3d40-46bd-9fff-72d9db61778e" returned: 0 in 0.681s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-a5794fbb-6aaa-40e5-b865-e472c0c7a0bc req-43bb217a-3b0e-4b30-bb76-09854d0d45e4 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.226s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13d6537-f8a0-4bb7-88a8-7c285ddad122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30611da5-3d40-46bd-9fff-72d9db61778e', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6113a1-e165-45ce-aab9-d117e2ab809e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2a94b8-05f4-4920-8d0f-1ce965cd3996]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-a5794fbb-6aaa-40e5-b865-e472c0c7a0bc req-43bb217a-3b0e-4b30-bb76-09854d0d45e4 tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:25 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Volume volume-30611da5-3d40-46bd-9fff-72d9db61778e (30611da5-3d40-46bd-9fff-72d9db61778e): created successfully Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6113a1-e165-45ce-aab9-d117e2ab809e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Flow 'volume_create_manager' (3665f6eb-c1af-469e-812c-dbf56edf74da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:25 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-a864bc74-27cc-4b11-9492-ad7ccf836422 tempest-GroupsTest-778167705 None] Created volume successfully. Jun 19 04:21:25 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8 Jun 19 04:21:25 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:26 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9" returned: 0 in 0.801s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a93c3549-8cd3-4194-a5bb-25e928a9b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0fd775-0751-45ce-ab99-bb51f1ef06dc]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:26 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 Jun 19 04:21:26 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:26 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-a5794fbb-6aaa-40e5-b865-e472c0c7a0bc req-43bb217a-3b0e-4b30-bb76-09854d0d45e4 tempest-AttachVolumeTestJSON-1314088858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8" returned: 0 in 0.794s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-a5794fbb-6aaa-40e5-b865-e472c0c7a0bc req-43bb217a-3b0e-4b30-bb76-09854d0d45e4 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.823s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.158s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1566674262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c40bcf6-3358-4864-bd93-20a89667ee4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de60639d4f8e44bf953c8331f9013d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:24Z,use_quota=True,user_id='3bf44df4963e490c8c9993636703434e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Creating volume 9c40bcf6-3358-4864-bd93-20a89667ee4f {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:26 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9c40bcf6-3358-4864-bd93-20a89667ee4f 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:26 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9c40bcf6-3358-4864-bd93-20a89667ee4f 1073741824 Jun 19 04:21:26 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-a5794fbb-6aaa-40e5-b865-e472c0c7a0bc req-43bb217a-3b0e-4b30-bb76-09854d0d45e4 tempest-AttachVolumeTestJSON-1314088858 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-d9312afc-c26e-4077-9f53-fde230f819d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ff58f0a-9978-4d45-8bc0-5328ed7d87e3', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:21:26 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-a5794fbb-6aaa-40e5-b865-e472c0c7a0bc req-43bb217a-3b0e-4b30-bb76-09854d0d45e4 tempest-AttachVolumeTestJSON-1314088858 None] attachment_update completed successfully. Jun 19 04:21:27 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332" returned: 0 in 0.954s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:27 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 Jun 19 04:21:27 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Flow 'volume_create_manager' (8630eb40-f6bc-4cdf-8fbc-d240b1f59742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0ad177-742e-4b89-8717-ba017dd508bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0ad177-742e-4b89-8717-ba017dd508bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1484084757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25cd6c4a-f66b-40fc-8be1-284b38d015de,host='devstack@QuobyteHD#QuobyteHD',id=4dc9dcdd-7d6d-4614-9065-3bae0268745c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf11a563fe4c403fade9db763d279024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:27Z,use_quota=True,user_id='6d13cee8299a4a6d8ad92c7f1dcfd3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4aa539f5-2054-4e2f-871f-05c8422e4d8a),volume_type_id=4aa539f5-2054-4e2f-871f-05c8422e4d8a)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7072a24-d9bf-494a-be99-b24220deb515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7072a24-d9bf-494a-be99-b24220deb515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9210301a-8814-406d-9add-347775269ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9210301a-8814-406d-9add-347775269ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc9dcdd-7d6d-4614-9065-3bae0268745c', 'volume_name': 'volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cea647-c589-4835-a2e8-e7b1eb255e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:27 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cea647-c589-4835-a2e8-e7b1eb255e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37dd1cf-cff3-4c9c-91dd-1a3089e8b059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:27 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Volume 4dc9dcdd-7d6d-4614-9065-3bae0268745c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c', 'volume_size': 1} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9c40bcf6-3358-4864-bd93-20a89667ee4f 1073741824" returned: 0 in 1.064s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9c40bcf6-3358-4864-bd93-20a89667ee4f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:27 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9c40bcf6-3358-4864-bd93-20a89667ee4f Jun 19 04:21:27 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:27 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9" returned: 0 in 0.861s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:27 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9 Jun 19 04:21:27 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:28 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9c40bcf6-3358-4864-bd93-20a89667ee4f" returned: 0 in 0.720s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.772s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=25cd6c4a-f66b-40fc-8be1-284b38d015de,created_at=2026-06-19T02:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1484084757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25cd6c4a-f66b-40fc-8be1-284b38d015de,host='devstack@QuobyteHD#QuobyteHD',id=4dc9dcdd-7d6d-4614-9065-3bae0268745c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf11a563fe4c403fade9db763d279024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:27Z,use_quota=True,user_id='6d13cee8299a4a6d8ad92c7f1dcfd3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4aa539f5-2054-4e2f-871f-05c8422e4d8a),volume_type_id=4aa539f5-2054-4e2f-871f-05c8422e4d8a)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Creating volume 4dc9dcdd-7d6d-4614-9065-3bae0268745c {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:28 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:28 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c 1073741824 Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b87a283-c8ec-42d4-9f7b-25ccdb226d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c40bcf6-3358-4864-bd93-20a89667ee4f', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:28 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c992e823-6d98-41a3-bb09-6d47d6db6ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:28 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Volume volume-9c40bcf6-3358-4864-bd93-20a89667ee4f (9c40bcf6-3358-4864-bd93-20a89667ee4f): created successfully Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c992e823-6d98-41a3-bb09-6d47d6db6ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Flow 'volume_create_manager' (62d537fd-9ad2-4af9-8b6e-3e37e9f85b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:28 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2fe15561-9dec-412d-bc76-ebbebe1d1e78 tempest-VolumesMetadataTest-1195916495 None] Created volume successfully. Jun 19 04:21:28 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332.01a5ef6b-7b81-4925-8b1a-2be0b1b173d9" returned: 0 in 0.805s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-01a5ef6b-7b81-4925-8b1a-2be0b1b173d9" released by "_delete_snapshot" :: held 3.552s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-a93c3549-8cd3-4194-a5bb-25e928a9b332" released by "delete_snapshot" :: held 3.574s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Created reservations ['d19b9865-3fe5-4982-8460-2902c9f23d31', '638e9bcc-6c1f-4fe6-881e-e60607eef365', 'f81e9737-d7cc-4622-be46-0d48e404dd0e', 'cf84e94f-c0b3-4c0a-8970-6a6fbe0b5d6e'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:28 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Delete snapshot completed successfully. Jun 19 04:21:28 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cf8d534a-5ff1-465e-97b7-6f33dbdecb9c tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-01a5ef6b-7b81-4925-8b1a-2be0b1b173d9-delete_snapshot" released by "delete_snapshot" :: held 3.776s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:29 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c 1073741824" returned: 0 in 0.951s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:29 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c Jun 19 04:21:29 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Acquiring lock "cinder-9c40bcf6-3358-4864-bd93-20a89667ee4f-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Lock "cinder-9c40bcf6-3358-4864-bd93-20a89667ee4f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Acquiring lock "cinder-quobyte-9c40bcf6-3358-4864-bd93-20a89667ee4f" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Lock "cinder-quobyte-9c40bcf6-3358-4864-bd93-20a89667ee4f" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:29 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1422c864-56d3-4e0a-b65b-c689252b67c2]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9c40bcf6-3358-4864-bd93-20a89667ee4f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:29 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9c40bcf6-3358-4864-bd93-20a89667ee4f Jun 19 04:21:29 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:29 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c" returned: 0 in 0.779s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:29 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37dd1cf-cff3-4c9c-91dd-1a3089e8b059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f241c1f4-8222-42e7-a95e-420abc4d4132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:30 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Volume volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c (4dc9dcdd-7d6d-4614-9065-3bae0268745c): created successfully Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f241c1f4-8222-42e7-a95e-420abc4d4132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Flow 'volume_create_manager' (8630eb40-f6bc-4cdf-8fbc-d240b1f59742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:30 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-67f00edf-b525-410f-aec8-64d05579a397 tempest-GroupsTest-778167705 None] Created volume successfully. Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Flow 'volume_create_manager' (ba4a8496-faec-4555-bfa9-d80614581881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb49cd32-18cf-443c-a4b0-c63917900731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb49cd32-18cf-443c-a4b0-c63917900731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1875060926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2a0824-b1b1-4fe6-89b5-3bb37e64b261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167294a48f504a8f96854d34e8ccc869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:30Z,use_quota=True,user_id='02cd0944a56a4a44a1a38a3f2820167d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdf1aa5-46c0-49b8-8824-42e56ffd384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdf1aa5-46c0-49b8-8824-42e56ffd384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d618ce-e906-4c80-8625-dd91d2119b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d618ce-e906-4c80-8625-dd91d2119b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f2a0824-b1b1-4fe6-89b5-3bb37e64b261', 'volume_name': 'volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ede683-66ac-4e51-a1ad-28ce3df3f944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ede683-66ac-4e51-a1ad-28ce3df3f944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c70cf75-0f65-48cb-8b3e-a55246ec95bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:30 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Volume 1f2a0824-b1b1-4fe6-89b5-3bb37e64b261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261', 'volume_size': 1} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1875060926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2a0824-b1b1-4fe6-89b5-3bb37e64b261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167294a48f504a8f96854d34e8ccc869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:30Z,use_quota=True,user_id='02cd0944a56a4a44a1a38a3f2820167d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Creating volume 1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:30 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:30 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 1073741824 Jun 19 04:21:30 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:30 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9c40bcf6-3358-4864-bd93-20a89667ee4f" returned: 0 in 0.834s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9c40bcf6-3358-4864-bd93-20a89667ee4f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:30 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9c40bcf6-3358-4864-bd93-20a89667ee4f Jun 19 04:21:30 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:31 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4594fd38-22df-4b97-be5b-32ae989fe5ec tempest-GroupsTest-778167705 None] Update group completed successfully. Jun 19 04:21:31 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9c40bcf6-3358-4864-bd93-20a89667ee4f" returned: 0 in 0.852s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Lock "cinder-quobyte-9c40bcf6-3358-4864-bd93-20a89667ee4f" released by "delete_volume" :: held 1.752s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Created reservations ['9b237e34-db45-4341-9042-6ed8a0c2b5d3', 'ba71d9e7-c90a-4fb5-925a-e27b05277d3b', '919d3cb6-8ec0-4c46-aff3-03851c52b57c', 'de75d41e-bc70-486b-b08f-ca794f2865d0'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:31 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 1073741824" returned: 0 in 1.075s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:31 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:21:31 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:31 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 Jun 19 04:21:31 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Flow 'volume_create_manager' (2575bc52-c8bd-42a8-8b83-f0b3d6b1a09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eac9568-80d8-4d7f-b833-30ae42377fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eac9568-80d8-4d7f-b833-30ae42377fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-454164575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8898361393604a9f9c2c58a51f3aa60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:32Z,use_quota=True,user_id='8504b3e3f72b4a028b4f82464cdddc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9465e950-a58f-49f2-a09e-d73ac1765cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9465e950-a58f-49f2-a09e-d73ac1765cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1126dd9f-0236-430f-af0e-bf01091c5077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1126dd9f-0236-430f-af0e-bf01091c5077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f', 'volume_name': 'volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7d5c3e-9760-4d20-a294-f5be508e71c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7d5c3e-9760-4d20-a294-f5be508e71c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ca1365-bff3-473d-82ac-527f6f24f56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:31 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Volume c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f', 'volume_size': 1} Jun 19 04:21:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:32 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261" returned: 0 in 0.705s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-454164575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8898361393604a9f9c2c58a51f3aa60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:32Z,use_quota=True,user_id='8504b3e3f72b4a028b4f82464cdddc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Creating volume c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:32 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:32 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.789s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:32 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f 1073741824 Jun 19 04:21:32 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:32 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Deleted volume successfully. Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c70cf75-0f65-48cb-8b3e-a55246ec95bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0184a89-a000-4bbe-a7e3-37316e9f2d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:32 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Volume volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 (1f2a0824-b1b1-4fe6-89b5-3bb37e64b261): created successfully Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0184a89-a000-4bbe-a7e3-37316e9f2d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Flow 'volume_create_manager' (ba4a8496-faec-4555-bfa9-d80614581881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-306d7454-5ef1-4901-be13-14d2063a72d8 tempest-VolumesMetadataTest-1195916495 None] Lock "cinder-9c40bcf6-3358-4864-bd93-20a89667ee4f-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:32 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-41e1a8f2-f4a9-4133-a275-3f22d587d2c7 tempest-VolumesSnapshotTestJSON-1029927790 None] Created volume successfully. Jun 19 04:21:32 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2d3d5dbd-4bf4-4c5c-b34a-d566df90458c tempest-GroupsTest-778167705 None] Update group completed successfully. Jun 19 04:21:33 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f 1073741824" returned: 0 in 0.997s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:33 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f Jun 19 04:21:33 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:34 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f" returned: 0 in 0.784s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.349s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] Creating offline snapshot 8cbf1dd5-94bb-48c3-9455-d06da88d298e of volume 1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ca1365-bff3-473d-82ac-527f6f24f56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706f4bbe-0e3c-4df5-b541-5dab3a3c5f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43f649c-27e4-4f99-9f01-9302ef00f21b]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:34 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Volume volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f (c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f): created successfully Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706f4bbe-0e3c-4df5-b541-5dab3a3c5f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Flow 'volume_create_manager' (2575bc52-c8bd-42a8-8b83-f0b3d6b1a09b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:34 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-0d259f3b-73cc-4e48-9681-d0bcef872a96 tempest-AttachVolumeTestJSON-1314088858 None] Created volume successfully. Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Acquiring lock "cinder-quobyte-30611da5-3d40-46bd-9fff-72d9db61778e" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:34 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 Jun 19 04:21:34 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Lock "cinder-quobyte-30611da5-3d40-46bd-9fff-72d9db61778e" acquired by "delete_volume" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5464548d-7dcb-4eb6-9e23-c0b1c98168ab]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-30611da5-3d40-46bd-9fff-72d9db61778e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:34 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-30611da5-3d40-46bd-9fff-72d9db61778e Jun 19 04:21:34 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:35 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261" returned: 0 in 1.001s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:35 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e 1G Jun 19 04:21:35 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:35 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-30611da5-3d40-46bd-9fff-72d9db61778e" returned: 0 in 1.001s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-30611da5-3d40-46bd-9fff-72d9db61778e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:35 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-30611da5-3d40-46bd-9fff-72d9db61778e Jun 19 04:21:35 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:36 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:36 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e 1G" returned: 0 in 1.048s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-30611da5-3d40-46bd-9fff-72d9db61778e" returned: 0 in 0.872s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Lock "cinder-quobyte-30611da5-3d40-46bd-9fff-72d9db61778e" released by "delete_volume" :: held 1.942s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Acquiring lock "cinder-quobyte-4dc9dcdd-7d6d-4614-9065-3bae0268745c" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:36 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e Jun 19 04:21:36 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Lock "cinder-quobyte-4dc9dcdd-7d6d-4614-9065-3bae0268745c" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:36 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69ac8fd-a731-45fb-a3c9-d66960891ad3]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:36 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c Jun 19 04:21:36 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:37 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e" returned: 0 in 0.949s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:37 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e is being set with open permissions: ugo+rw Jun 19 04:21:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:37 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e Jun 19 04:21:37 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:37 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c" returned: 0 in 0.938s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:37 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c Jun 19 04:21:37 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:38 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e" returned: 0 in 0.847s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:38 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.info Jun 19 04:21:38 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:38 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4dc9dcdd-7d6d-4614-9065-3bae0268745c" returned: 0 in 0.883s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Lock "cinder-quobyte-4dc9dcdd-7d6d-4614-9065-3bae0268745c" released by "delete_volume" :: held 1.870s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Created reservations ['ecb11c56-b95e-42a0-8856-017760ce712f'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:38 devstack cinder-volume[93300]: WARNING cinder.quota [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-951402896 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-951402896, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:21:38 devstack cinder-volume[93300]: WARNING cinder.quota [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-951402896 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-951402896, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Created reservations ['b549db9b-bba6-499d-a247-9c241430bde1', 'e70e0d23-1ebd-40f0-aa28-fe49566b584d', 'a7eda9ad-5256-4128-b947-8727d83df926', '8ad690a3-b8f6-4047-95c1-df375bf8124b'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Created reservations ['8064875d-ab01-4f29-886b-0c08f33e8593', '67f15dd6-919f-4186-9708-e21442c10138', '10c3910e-39c7-4b6b-a390-5920968c7999', 'a7364448-9913-4247-8966-858f7d598b03'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-b824b7da-5042-4872-9641-c40d0d9e0499 req-6fce232f-66c6-442b-8335-d6800b68c777 tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:38 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:21:38 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:39 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.info" returned: 0 in 0.899s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:39 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.info is being set with open permissions: ugo+rw Jun 19 04:21:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:39 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.info Jun 19 04:21:39 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:39 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.764s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:39 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:39 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e78847d0-c975-46b4-9ea9-0f78e62ab0c8 tempest-GroupsTest-778167705 None] Delete group completed successfully. Jun 19 04:21:39 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.info" returned: 0 in 0.896s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.765s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-b824b7da-5042-4872-9641-c40d0d9e0499 req-6fce232f-66c6-442b-8335-d6800b68c777 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.212s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:39 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d9f1b1-3d87-4421-9d30-9ebc8ceb3ced]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-b824b7da-5042-4872-9641-c40d0d9e0499 req-6fce232f-66c6-442b-8335-d6800b68c777 tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:40 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-687882af-35ad-4231-9348-0363a3c94d69 tempest-VolumesSnapshotTestJSON-1029927790 None] Create snapshot completed successfully Jun 19 04:21:40 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f Jun 19 04:21:40 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:40 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Flow 'volume_create_manager' (867012d4-56be-4fe4-91a4-b680bd1a4c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20113e1b-b793-45f0-b00c-d40380d07d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20113e1b-b793-45f0-b00c-d40380d07d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1712416876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d94790-c297-4cbe-bd0d-239d0451e319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167294a48f504a8f96854d34e8ccc869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8cbf1dd5-94bb-48c3-9455-d06da88d298e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:41Z,use_quota=True,user_id='02cd0944a56a4a44a1a38a3f2820167d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b47ce1-9a03-4356-98e6-f682a99a0451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b47ce1-9a03-4356-98e6-f682a99a0451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ade1c6-6db3-49a9-b93b-0a556c740f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ade1c6-6db3-49a9-b93b-0a556c740f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12d94790-c297-4cbe-bd0d-239d0451e319', 'volume_name': 'volume-12d94790-c297-4cbe-bd0d-239d0451e319', 'volume_size': 2, 'snapshot_id': '8cbf1dd5-94bb-48c3-9455-d06da88d298e'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a697a09-3cb7-41f5-a9c1-7f7d68a809e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a697a09-3cb7-41f5-a9c1-7f7d68a809e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97eb4bcb-37a6-4d83-98fe-0154de2a531d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:41 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Volume 12d94790-c297-4cbe-bd0d-239d0451e319: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12d94790-c297-4cbe-bd0d-239d0451e319', 'volume_size': 2, 'snapshot_id': '8cbf1dd5-94bb-48c3-9455-d06da88d298e'} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:41 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-b824b7da-5042-4872-9641-c40d0d9e0499 req-6fce232f-66c6-442b-8335-d6800b68c777 tempest-AttachVolumeTestJSON-1314088858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f" returned: 0 in 1.053s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-b824b7da-5042-4872-9641-c40d0d9e0499 req-6fce232f-66c6-442b-8335-d6800b68c777 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.085s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.020s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-8cbf1dd5-94bb-48c3-9455-d06da88d298e-12d94790-c297-4cbe-bd0d-239d0451e319" by "_create_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-8cbf1dd5-94bb-48c3-9455-d06da88d298e-12d94790-c297-4cbe-bd0d-239d0451e319" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Creating volume 12d94790-c297-4cbe-bd0d-239d0451e319 from snapshot 8cbf1dd5-94bb-48c3-9455-d06da88d298e {{(pid=93300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-12d94790-c297-4cbe-bd0d-239d0451e319" by "_copy_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-b824b7da-5042-4872-9641-c40d0d9e0499 req-6fce232f-66c6-442b-8335-d6800b68c777 tempest-AttachVolumeTestJSON-1314088858 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb132f34-9a55-43b6-b8c5-6f2b80db6eaf', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-12d94790-c297-4cbe-bd0d-239d0451e319" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] snapshot: 8cbf1dd5-94bb-48c3-9455-d06da88d298e, volume: 12d94790-c297-4cbe-bd0d-239d0451e319, {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[32157f89-f793-41dc-954f-9973c0162443]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:41 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-b824b7da-5042-4872-9641-c40d0d9e0499 req-6fce232f-66c6-442b-8335-d6800b68c777 tempest-AttachVolumeTestJSON-1314088858 None] attachment_update completed successfully. Jun 19 04:21:41 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e Jun 19 04:21:41 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:42 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e" returned: 0 in 1.024s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:21:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Creating direct copy from snapshot {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:21:42 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2ec300-cf19-4c5a-8bac-dcabf1860d5e]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:42 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 Jun 19 04:21:42 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:43 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261" returned: 0 in 1.061s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:43 devstack cinder-volume[93300]: DEBUG cinder.utils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Path /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319 not found in is_blk_device check {{(pid=93300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:21:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:43 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319 Jun 19 04:21:43 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:50 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319" returned: 0 in 7.151s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6c8f5b-6df5-4606-9ea8-525b2bb4b681]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:50 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 Jun 19 04:21:50 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Flow 'volume_create_manager' (84456045-de7d-4e53-a4a7-1e4c5b5904f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df23a3da-637f-4e4b-9c68-9384b6663415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df23a3da-637f-4e4b-9c68-9384b6663415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1791496286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a47386d-d77f-4ee1-a747-7d07b7fba800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973c3816b8a94a0c8c05959a6156ace5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:51Z,use_quota=True,user_id='a0fadfdf0f4c4bbe987308ace8e37fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee97275b-0fa0-47a0-b452-1a51dfb1cad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee97275b-0fa0-47a0-b452-1a51dfb1cad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe41e60-336c-41f7-9e7c-00c773eaa0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe41e60-336c-41f7-9e7c-00c773eaa0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a47386d-d77f-4ee1-a747-7d07b7fba800', 'volume_name': 'volume-8a47386d-d77f-4ee1-a747-7d07b7fba800', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150a5d61-7fb1-4a20-a14c-205febfa6be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150a5d61-7fb1-4a20-a14c-205febfa6be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f790785-1830-482d-b283-e1f2c7c2c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:50 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Volume 8a47386d-d77f-4ee1-a747-7d07b7fba800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a47386d-d77f-4ee1-a747-7d07b7fba800', 'volume_size': 1} Jun 19 04:21:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:51 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-1e4e2ddf-11c8-45c8-8bdc-1bd8a8ab4bc0 req-b3b1594e-83d8-434c-9ab7-8611c5c32467 tempest-AttachVolumeTestJSON-1314088858 None] Terminate volume connection completed successfully. Jun 19 04:21:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-1e4e2ddf-11c8-45c8-8bdc-1bd8a8ab4bc0 req-b3b1594e-83d8-434c-9ab7-8611c5c32467 tempest-AttachVolumeTestJSON-1314088858 None] Deleting attachment 5ff58f0a-9978-4d45-8bc0-5328ed7d87e3. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:21:51 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261" returned: 0 in 0.993s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:51 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261, size 1024.00 MB, duration 7.15 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:21:51 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Converted 1024.00 MB image at 143.16 MB/s Jun 19 04:21:51 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319 is being set with open permissions: ugo+rw Jun 19 04:21:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:51 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319 Jun 19 04:21:51 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:52 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319" returned: 0 in 0.778s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-12d94790-c297-4cbe-bd0d-239d0451e319" released by "_copy_volume_from_snapshot" :: held 11.238s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-8cbf1dd5-94bb-48c3-9455-d06da88d298e-12d94790-c297-4cbe-bd0d-239d0451e319" released by "_create_volume_from_snapshot" :: held 11.283s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.318s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1791496286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a47386d-d77f-4ee1-a747-7d07b7fba800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973c3816b8a94a0c8c05959a6156ace5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:51Z,use_quota=True,user_id='a0fadfdf0f4c4bbe987308ace8e37fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Creating volume 8a47386d-d77f-4ee1-a747-7d07b7fba800 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:52 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:52 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 1073741824 Jun 19 04:21:52 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97eb4bcb-37a6-4d83-98fe-0154de2a531d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12d94790-c297-4cbe-bd0d-239d0451e319', 'volume_size': 2, 'snapshot_id': '8cbf1dd5-94bb-48c3-9455-d06da88d298e'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490f2f03-60a9-4c0b-aea3-7f9644889191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:52 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Volume volume-12d94790-c297-4cbe-bd0d-239d0451e319 (12d94790-c297-4cbe-bd0d-239d0451e319): created successfully Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490f2f03-60a9-4c0b-aea3-7f9644889191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Flow 'volume_create_manager' (867012d4-56be-4fe4-91a4-b680bd1a4c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:52 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2265f7ee-3da0-4d87-b82f-a657b9b94c29 tempest-VolumesSnapshotTestJSON-1029927790 None] Created volume successfully. Jun 19 04:21:53 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 1073741824" returned: 0 in 1.169s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:53 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 Jun 19 04:21:53 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-12d94790-c297-4cbe-bd0d-239d0451e319-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-12d94790-c297-4cbe-bd0d-239d0451e319-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-12d94790-c297-4cbe-bd0d-239d0451e319" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-12d94790-c297-4cbe-bd0d-239d0451e319" acquired by "delete_volume" :: waited 0.024s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:53 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1236b3db-afad-48a7-b634-5b64b446d387]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:53 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319 Jun 19 04:21:53 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:54 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-085fc4f3-3290-461b-af53-5146923a3010 req-72f555a9-d443-487b-abb2-88562a44d0e1 tempest-AttachVolumeTestJSON-1314088858 None] Terminate volume connection completed successfully. Jun 19 04:21:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-085fc4f3-3290-461b-af53-5146923a3010 req-72f555a9-d443-487b-abb2-88562a44d0e1 tempest-AttachVolumeTestJSON-1314088858 None] Deleting attachment eb132f34-9a55-43b6-b8c5-6f2b80db6eaf. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:21:54 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800" returned: 0 in 0.852s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f790785-1830-482d-b283-e1f2c7c2c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a47386d-d77f-4ee1-a747-7d07b7fba800', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e8e0ad-4d7e-4907-b6e4-e169ed85ee67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:54 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Volume volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 (8a47386d-d77f-4ee1-a747-7d07b7fba800): created successfully Jun 19 04:21:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e8e0ad-4d7e-4907-b6e4-e169ed85ee67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Flow 'volume_create_manager' (84456045-de7d-4e53-a4a7-1e4c5b5904f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:54 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3e856001-20dd-4e5c-8962-94ea1b574058 tempest-VolumesActionsTest-1931475445 None] Created volume successfully. Jun 19 04:21:54 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319" returned: 0 in 1.003s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:54 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319 Jun 19 04:21:54 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:55 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-12d94790-c297-4cbe-bd0d-239d0451e319" returned: 0 in 0.757s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-12d94790-c297-4cbe-bd0d-239d0451e319" released by "delete_volume" :: held 1.843s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:55 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Created reservations ['f2ac43ce-887c-46c3-87c6-d4480d59ba00', 'c9e669c5-eae8-475e-95a5-64de3551dbf1', 'a99dd3b8-a45c-46b9-981d-c8bea7a9c3f4', '3c873d68-115a-4830-8433-34955142c580'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:55 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:21:55 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-8cbf1dd5-94bb-48c3-9455-d06da88d298e-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-8cbf1dd5-94bb-48c3-9455-d06da88d298e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-8cbf1dd5-94bb-48c3-9455-d06da88d298e" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-8cbf1dd5-94bb-48c3-9455-d06da88d298e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Deleting offline snapshot 8cbf1dd5-94bb-48c3-9455-d06da88d298e of volume 1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:21:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] snapshot_file for this snap is: volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:21:56 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[832d0469-cac2-4101-a713-196438b60fbc]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:56 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e Jun 19 04:21:56 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:56 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.183s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:56 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:56 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Deleted volume successfully. Jun 19 04:21:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8f85050b-a2b2-4a36-922c-1eafea618ba5 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-12d94790-c297-4cbe-bd0d-239d0451e319-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:57 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e" returned: 0 in 1.180s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:57 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:57 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[479d589c-500b-4436-bcbc-23ca47b6053c]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:57 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 Jun 19 04:21:57 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:58 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261" returned: 0 in 1.045s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:58 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e Jun 19 04:21:58 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:59 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e" returned: 0 in 1.002s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:59 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e Jun 19 04:21:59 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:00 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261.8cbf1dd5-94bb-48c3-9455-d06da88d298e" returned: 0 in 0.846s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-8cbf1dd5-94bb-48c3-9455-d06da88d298e" released by "_delete_snapshot" :: held 4.242s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261" released by "delete_snapshot" :: held 4.281s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:00 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Created reservations ['7adb60d1-512d-4ee3-8c91-ac98fadb98d8', '23daa7ed-8192-46de-b015-d00d506eb1e8', 'a1318789-9484-41bd-bc0e-825e054e6792', 'e1987e62-b3d4-450c-bf44-7cfae7612d24'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:00 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Delete snapshot completed successfully. Jun 19 04:22:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-af8b4e0a-d604-4888-b09c-0f6decd23ae4 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-8cbf1dd5-94bb-48c3-9455-d06da88d298e-delete_snapshot" released by "delete_snapshot" :: held 4.524s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261" acquired by "delete_volume" :: waited 0.032s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:01 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c03300-aea2-4c8c-ad50-4e50d9d32d4b]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:01 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 Jun 19 04:22:01 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:02 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261" returned: 0 in 0.796s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:02 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261 Jun 19 04:22:02 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:03 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261" returned: 0 in 0.819s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261" released by "delete_volume" :: held 1.728s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:03 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Created reservations ['ea72837f-7fc5-4da2-a5f2-df01cae61c0a', 'e5f5ca63-0e81-4801-8f13-519e2f9a46a7', '88979f72-c4ef-470d-99f2-008e9c7f4b47', '7916f0dc-283e-4078-a026-4a28dc82e878'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:03 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:22:03 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Flow 'volume_create_manager' (b914f180-26af-4afb-8a58-f2310d4afd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a763e573-c4c8-4cb0-bdf5-a1b9bb2b5938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:04 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.129s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:04 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Deleted volume successfully. Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a763e573-c4c8-4cb0-bdf5-a1b9bb2b5938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1743507984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f2578e-ac40-4f65-87a5-86f1c3d577bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167294a48f504a8f96854d34e8ccc869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:05Z,use_quota=True,user_id='02cd0944a56a4a44a1a38a3f2820167d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cdbb175-8fca-40f7-99c5-f6e9af1041be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cdbb175-8fca-40f7-99c5-f6e9af1041be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4817b59-2992-41a8-a513-6940909302fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4817b59-2992-41a8-a513-6940909302fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f2578e-ac40-4f65-87a5-86f1c3d577bc', 'volume_name': 'volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae17948f-358d-49f2-960a-5e9e4ee67c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae17948f-358d-49f2-960a-5e9e4ee67c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9e16c7-b3c8-45d7-b95b-74fd3c465081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:04 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Volume 23f2578e-ac40-4f65-87a5-86f1c3d577bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc', 'volume_size': 1} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1743507984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f2578e-ac40-4f65-87a5-86f1c3d577bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167294a48f504a8f96854d34e8ccc869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:05Z,use_quota=True,user_id='02cd0944a56a4a44a1a38a3f2820167d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Creating volume 23f2578e-ac40-4f65-87a5-86f1c3d577bc {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:04 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-a6942aad-c62d-4bb7-a707-6b5261353177 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-1f2a0824-b1b1-4fe6-89b5-3bb37e64b261-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:04 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc 1073741824 Jun 19 04:22:04 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:06 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc 1073741824" returned: 0 in 1.240s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:06 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc Jun 19 04:22:06 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "cinder-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Lock "cinder-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "cinder-quobyte-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Lock "cinder-quobyte-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3c998b-36cf-433c-901b-52ba035aea24]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:06 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc" returned: 0 in 0.781s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9e16c7-b3c8-45d7-b95b-74fd3c465081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b956481-ff5c-4f23-a1c0-ebb91dda6c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:06 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Volume volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc (23f2578e-ac40-4f65-87a5-86f1c3d577bc): created successfully Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b956481-ff5c-4f23-a1c0-ebb91dda6c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Flow 'volume_create_manager' (b914f180-26af-4afb-8a58-f2310d4afd27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:06 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-35097079-8d2e-4c5a-bdbc-8e3191184c91 tempest-VolumesSnapshotTestJSON-1029927790 None] Created volume successfully. Jun 19 04:22:06 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f Jun 19 04:22:06 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Flow 'volume_create_manager' (fa62be6b-bfe9-4ebd-984a-afa6b2834362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd53332-b15a-411f-9114-6d90feefd778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd53332-b15a-411f-9114-6d90feefd778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-115833665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c71662-2cf8-4f91-b1bf-abe31684f4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7e3f4a8e674f159379970a1e82dfc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:07Z,use_quota=True,user_id='484d57cc0c164be78ef477a0164022d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0769d4-ba0a-42e7-94f0-021a5118a87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0769d4-ba0a-42e7-94f0-021a5118a87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba569613-725b-4e33-8ff3-697e8ad7636f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba569613-725b-4e33-8ff3-697e8ad7636f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c71662-2cf8-4f91-b1bf-abe31684f4fb', 'volume_name': 'volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6109736e-b85e-434e-82c0-ae7a22cc8e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6109736e-b85e-434e-82c0-ae7a22cc8e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c454b53f-525a-4e78-9d69-a57b6b9de123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:07 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Volume e1c71662-2cf8-4f91-b1bf-abe31684f4fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb', 'volume_size': 1} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-115833665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c71662-2cf8-4f91-b1bf-abe31684f4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7e3f4a8e674f159379970a1e82dfc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:07Z,use_quota=True,user_id='484d57cc0c164be78ef477a0164022d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Creating volume e1c71662-2cf8-4f91-b1bf-abe31684f4fb {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:07 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:07 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb 1073741824 Jun 19 04:22:07 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:07 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f" returned: 0 in 0.883s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:07 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f Jun 19 04:22:07 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:08 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb 1073741824" returned: 0 in 1.000s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:08 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb Jun 19 04:22:08 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:08 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f" returned: 0 in 0.835s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Lock "cinder-quobyte-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f" released by "delete_volume" :: held 1.780s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Created reservations ['ef936b82-5059-44e6-8bbc-a3bb9e2f9438', 'bb649db4-4ad3-4429-bc62-b2dc2385aa58', '22ca3a1a-dd0b-4c12-a090-ff2f882248bf', 'f79e85b4-d2cf-4746-b621-f5a365d66f82'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:08 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:22:08 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "cinder-d9312afc-c26e-4077-9f53-fde230f819d8-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Lock "cinder-d9312afc-c26e-4077-9f53-fde230f819d8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:09 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb" returned: 0 in 0.711s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.993s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "cinder-quobyte-d9312afc-c26e-4077-9f53-fde230f819d8" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] Creating offline snapshot dbf3dd89-81a5-4537-be19-b83c8174d05e of volume 23f2578e-ac40-4f65-87a5-86f1c3d577bc {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Lock "cinder-quobyte-d9312afc-c26e-4077-9f53-fde230f819d8" acquired by "delete_volume" :: waited 0.033s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c454b53f-525a-4e78-9d69-a57b6b9de123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea15edc-b746-4cd6-84c9-e492f2de531c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9321e45-8f97-44c7-95d9-5819b0bfee90]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b0824d-3af7-4af6-871e-41bc3f69e80b]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:09 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Volume volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb (e1c71662-2cf8-4f91-b1bf-abe31684f4fb): created successfully Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea15edc-b746-4cd6-84c9-e492f2de531c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Flow 'volume_create_manager' (fa62be6b-bfe9-4ebd-984a-afa6b2834362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:09 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c4096341-e161-4dbe-9c30-b18ead3c24e2 tempest-VolumeQuotasAdminTestJSON-1225306467 None] Created volume successfully. Jun 19 04:22:09 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc Jun 19 04:22:09 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:09 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8 Jun 19 04:22:09 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:09 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Acquiring lock "cinder-e1c71662-2cf8-4f91-b1bf-abe31684f4fb-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.796s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:09 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Deleted volume successfully. Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "cinder-e1c71662-2cf8-4f91-b1bf-abe31684f4fb-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-598b0de9-7dcb-4672-af62-5e1f31ac9f09 tempest-AttachVolumeTestJSON-1314088858 None] Lock "cinder-c6c667f1-80a7-4d03-8cbc-cad1bb9e6e9f-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Acquiring lock "cinder-quobyte-e1c71662-2cf8-4f91-b1bf-abe31684f4fb" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "cinder-quobyte-e1c71662-2cf8-4f91-b1bf-abe31684f4fb" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd2e9d1-0313-4508-ab44-166f3aafba98]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:09 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb Jun 19 04:22:09 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:10 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc" returned: 0 in 0.910s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:10 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e 1G Jun 19 04:22:10 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:10 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8" returned: 0 in 1.104s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:10 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8 Jun 19 04:22:10 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:10 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb" returned: 0 in 0.805s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:10 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb Jun 19 04:22:10 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:10 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d9312afc-c26e-4077-9f53-fde230f819d8" returned: 0 in 0.716s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:10 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e 1G" returned: 0 in 0.946s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Lock "cinder-quobyte-d9312afc-c26e-4077-9f53-fde230f819d8" released by "delete_volume" :: held 1.903s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:11 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e Jun 19 04:22:11 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Created reservations ['30c469d3-4f0f-4489-b0c4-85fa855604b7', '797e25ff-8993-437e-a76e-a2abf8103701', '1083e707-83ee-48fe-a183-80540db7260c', '60431331-3e31-4cbb-a566-4d751b7cb549'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:11 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e1c71662-2cf8-4f91-b1bf-abe31684f4fb" returned: 0 in 0.813s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "cinder-quobyte-e1c71662-2cf8-4f91-b1bf-abe31684f4fb" released by "delete_volume" :: held 1.691s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:11 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:22:11 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Created reservations ['41618949-1d8b-4836-9d68-26d2cdf9bde8', 'ec5518d5-42f8-4537-91be-669a77b53adb', '4058767e-4261-45db-bdf5-99ee514ae8d7', '4f64bc34-0894-4822-b061-b6d4348989ef'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "cinder-7f83865c-9ad6-4134-9234-a305430faba1-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:11 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:22:11 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Lock "cinder-7f83865c-9ad6-4134-9234-a305430faba1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "cinder-quobyte-7f83865c-9ad6-4134-9234-a305430faba1" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Lock "cinder-quobyte-7f83865c-9ad6-4134-9234-a305430faba1" acquired by "delete_volume" :: waited 0.024s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d6f9f5-b6aa-4fe0-9eaf-0c98af5a608d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:12 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1 Jun 19 04:22:12 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:12 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e" returned: 0 in 1.105s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:12 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e is being set with open permissions: ugo+rw Jun 19 04:22:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:12 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e Jun 19 04:22:12 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:12 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.491s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:12 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:12 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Deleted volume successfully. Jun 19 04:22:12 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e53af11b-16ae-4b4f-89b9-31ab48a5612b tempest-AttachVolumeTestJSON-1314088858 None] Lock "cinder-d9312afc-c26e-4077-9f53-fde230f819d8-delete_volume" released by "delete_volume" :: held 3.853s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:13 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.656s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:13 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Deleted volume successfully. Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-53c6f546-dc93-4e30-95a4-b8916a7c08de tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "cinder-e1c71662-2cf8-4f91-b1bf-abe31684f4fb-delete_volume" released by "delete_volume" :: held 3.737s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:13 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1" returned: 0 in 1.536s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:13 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1 Jun 19 04:22:13 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Flow 'volume_create_manager' (962cbd56-45e9-4516-aec8-90bd5d30ea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b600fd0d-299b-463e-8951-0e9baeaf229e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b600fd0d-299b-463e-8951-0e9baeaf229e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-501722874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f923542b-747a-4b6d-b082-96e32bf3e357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7e3f4a8e674f159379970a1e82dfc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:14Z,use_quota=True,user_id='484d57cc0c164be78ef477a0164022d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbfae1a-5d98-488b-9d6a-4c6ba091bb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbfae1a-5d98-488b-9d6a-4c6ba091bb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86ae744-e138-4cd3-bb80-927681cbff59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86ae744-e138-4cd3-bb80-927681cbff59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f923542b-747a-4b6d-b082-96e32bf3e357', 'volume_name': 'volume-f923542b-747a-4b6d-b082-96e32bf3e357', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c603ef4-a88a-4d25-9305-151e2ca4edd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c603ef4-a88a-4d25-9305-151e2ca4edd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed25c781-9136-4386-a204-9b73d8bc6aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:13 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Volume f923542b-747a-4b6d-b082-96e32bf3e357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f923542b-747a-4b6d-b082-96e32bf3e357', 'volume_size': 1} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:13 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e" returned: 0 in 1.808s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:13 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.info Jun 19 04:22:13 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:14 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7f83865c-9ad6-4134-9234-a305430faba1" returned: 0 in 1.055s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Lock "cinder-quobyte-7f83865c-9ad6-4134-9234-a305430faba1" released by "delete_volume" :: held 2.668s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:14 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Created reservations ['76c5de8d-1811-4328-a3b3-f61f0e285ea6', '8b42d6e1-a211-4971-9276-0205685fd954', '52e42426-e3ea-4940-b0b4-0a62ebe42a8c', 'b2d4ea7c-7c30-43c8-8079-16009e0753f3'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:14 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:22:14 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:14 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.info" returned: 0 in 0.900s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:14 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.info is being set with open permissions: ugo+rw Jun 19 04:22:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:14 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.info Jun 19 04:22:14 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:15 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.156s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:15 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Deleted volume successfully. Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8b17661d-796b-4f52-a7c0-586324121abf tempest-AttachVolumeTestJSON-1314088858 None] Lock "cinder-7f83865c-9ad6-4134-9234-a305430faba1-delete_volume" released by "delete_volume" :: held 4.146s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:15 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.info" returned: 0 in 1.035s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.858s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.081s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-501722874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f923542b-747a-4b6d-b082-96e32bf3e357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7e3f4a8e674f159379970a1e82dfc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:14Z,use_quota=True,user_id='484d57cc0c164be78ef477a0164022d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Creating volume f923542b-747a-4b6d-b082-96e32bf3e357 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:15 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:22:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f923542b-747a-4b6d-b082-96e32bf3e357 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:15 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f923542b-747a-4b6d-b082-96e32bf3e357 1073741824 Jun 19 04:22:15 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4e2ac11d-af5b-424f-813d-8b2154dcad0b tempest-VolumesActionsTest-1931475445 None] Acquiring lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800" by "attach_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c69ac768-40ad-4194-82b0-78ab3ca2341d tempest-VolumesSnapshotTestJSON-1029927790 None] Create snapshot completed successfully Jun 19 04:22:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4e2ac11d-af5b-424f-813d-8b2154dcad0b tempest-VolumesActionsTest-1931475445 None] Lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800" acquired by "attach_volume" :: waited 0.031s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4e2ac11d-af5b-424f-813d-8b2154dcad0b tempest-VolumesActionsTest-1931475445 None] Attaching volume 8a47386d-d77f-4ee1-a747-7d07b7fba800 to instance 93a75a02-2641-404b-bf6b-87c740503602 at mountpoint /dev/vdb on host None. Jun 19 04:22:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4e2ac11d-af5b-424f-813d-8b2154dcad0b tempest-VolumesActionsTest-1931475445 None] Attach volume completed successfully. Jun 19 04:22:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4e2ac11d-af5b-424f-813d-8b2154dcad0b tempest-VolumesActionsTest-1931475445 None] Lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800" released by "attach_volume" :: held 0.138s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fd6dec4d-faec-4f9e-9df7-f4fe68c455f6 tempest-VolumesActionsTest-1931475445 None] Acquiring lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800-detach_volume" by "detach_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fd6dec4d-faec-4f9e-9df7-f4fe68c455f6 tempest-VolumesActionsTest-1931475445 None] Lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-fd6dec4d-faec-4f9e-9df7-f4fe68c455f6 tempest-VolumesActionsTest-1931475445 None] Detaching volume 8a47386d-d77f-4ee1-a747-7d07b7fba800 from instance 93a75a02-2641-404b-bf6b-87c740503602. Jun 19 04:22:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-fd6dec4d-faec-4f9e-9df7-f4fe68c455f6 tempest-VolumesActionsTest-1931475445 None] Detach volume completed successfully. Jun 19 04:22:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-fd6dec4d-faec-4f9e-9df7-f4fe68c455f6 tempest-VolumesActionsTest-1931475445 None] Lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:17 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f923542b-747a-4b6d-b082-96e32bf3e357 1073741824" returned: 0 in 1.354s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f923542b-747a-4b6d-b082-96e32bf3e357 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:17 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f923542b-747a-4b6d-b082-96e32bf3e357 Jun 19 04:22:17 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Flow 'volume_create_manager' (d840af0b-e720-4f82-85e9-351f03289b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c205a921-98c4-4871-b1a1-96c500b45dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c205a921-98c4-4871-b1a1-96c500b45dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1596592401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e8ae9d-d59b-4bdf-b577-08312b41dd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167294a48f504a8f96854d34e8ccc869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dbf3dd89-81a5-4537-be19-b83c8174d05e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:18Z,use_quota=True,user_id='02cd0944a56a4a44a1a38a3f2820167d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7345d01a-66ba-4274-8cdf-153e3cbc17a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7345d01a-66ba-4274-8cdf-153e3cbc17a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3153788a-5563-4fd9-92b3-5ff20a3d5f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3153788a-5563-4fd9-92b3-5ff20a3d5f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '67e8ae9d-d59b-4bdf-b577-08312b41dd38', 'volume_name': 'volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38', 'volume_size': 1, 'snapshot_id': 'dbf3dd89-81a5-4537-be19-b83c8174d05e'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158f0d2a-e6ad-4ae7-9d85-d220fd0a103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158f0d2a-e6ad-4ae7-9d85-d220fd0a103e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935633f3-d77c-4dd6-8b0f-c6c07493a253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:17 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Volume 67e8ae9d-d59b-4bdf-b577-08312b41dd38: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38', 'volume_size': 1, 'snapshot_id': 'dbf3dd89-81a5-4537-be19-b83c8174d05e'} Jun 19 04:22:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:18 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f923542b-747a-4b6d-b082-96e32bf3e357" returned: 0 in 1.068s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] <== create_volume: return (2484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.488s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.537s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-dbf3dd89-81a5-4537-be19-b83c8174d05e-67e8ae9d-d59b-4bdf-b577-08312b41dd38" by "_create_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed25c781-9136-4386-a204-9b73d8bc6aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f923542b-747a-4b6d-b082-96e32bf3e357', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4529f60-2057-4eb0-82d6-11b9f8413b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-dbf3dd89-81a5-4537-be19-b83c8174d05e-67e8ae9d-d59b-4bdf-b577-08312b41dd38" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Creating volume 67e8ae9d-d59b-4bdf-b577-08312b41dd38 from snapshot dbf3dd89-81a5-4537-be19-b83c8174d05e {{(pid=93300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-67e8ae9d-d59b-4bdf-b577-08312b41dd38" by "_copy_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:18 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Volume volume-f923542b-747a-4b6d-b082-96e32bf3e357 (f923542b-747a-4b6d-b082-96e32bf3e357): created successfully Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4529f60-2057-4eb0-82d6-11b9f8413b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Flow 'volume_create_manager' (962cbd56-45e9-4516-aec8-90bd5d30ea28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-67e8ae9d-d59b-4bdf-b577-08312b41dd38" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] snapshot: dbf3dd89-81a5-4537-be19-b83c8174d05e, volume: 67e8ae9d-d59b-4bdf-b577-08312b41dd38, {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:22:18 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-7d3636cb-fd5e-470f-b792-dce3b11a551c tempest-VolumeQuotasAdminTestJSON-1225306467 None] Created volume successfully. Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e800c6f5-bd8b-4696-9566-acbfcbd25e50]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:18 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e Jun 19 04:22:18 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:22:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:19 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:22:19 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:20 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e" returned: 0 in 1.575s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:20 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:22:20 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:22:20 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Creating direct copy from snapshot {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:22:20 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfb074e-a448-4a44-9bd1-13f4750c720a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:20 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-1bf60685-4707-448b-beb4-15537fb60585 tempest-VolumeQuotasAdminTestJSON-577684613 None] Transfer volume completed successfully. Jun 19 04:22:20 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc Jun 19 04:22:20 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:20 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.255s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:20 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:22:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 8 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:22:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:22:21 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc" returned: 0 in 1.122s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:21 devstack cinder-volume[93300]: DEBUG cinder.utils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Path /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38 not found in is_blk_device check {{(pid=93300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:22:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:21 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38 Jun 19 04:22:21 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Acquiring lock "cinder-f923542b-747a-4b6d-b082-96e32bf3e357-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Lock "cinder-f923542b-747a-4b6d-b082-96e32bf3e357-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Acquiring lock "cinder-quobyte-f923542b-747a-4b6d-b082-96e32bf3e357" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Lock "cinder-quobyte-f923542b-747a-4b6d-b082-96e32bf3e357" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:21 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cd5246-547a-4c2c-91ac-75cd3741bd45]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f923542b-747a-4b6d-b082-96e32bf3e357 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:21 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f923542b-747a-4b6d-b082-96e32bf3e357 Jun 19 04:22:21 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:23 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f923542b-747a-4b6d-b082-96e32bf3e357" returned: 0 in 1.284s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f923542b-747a-4b6d-b082-96e32bf3e357 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:23 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f923542b-747a-4b6d-b082-96e32bf3e357 Jun 19 04:22:23 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:24 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f923542b-747a-4b6d-b082-96e32bf3e357" returned: 0 in 1.531s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Lock "cinder-quobyte-f923542b-747a-4b6d-b082-96e32bf3e357" released by "delete_volume" :: held 2.897s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:24 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=122,cinder:UPDATE=122,cinder:INSERT=32,cinder:DELETE=13 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:22:24 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=120,cinder:UPDATE=133,cinder:INSERT=27,cinder:DELETE=7 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:22:24 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Created reservations ['4204d707-bbd1-425f-b28e-4b37e7478e55', '1e665c0c-e37d-494f-82fc-917c32818c58', '1e843c36-f294-43f1-9400-9fbb42169cbd', '568192f9-f77c-4be6-b2c4-6d4e0783135f'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:25 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:22:25 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:27 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 2.307s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:27 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:27 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Deleted volume successfully. Jun 19 04:22:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-876e3c64-4174-4a83-aeda-bd5cada04d5e tempest-VolumeQuotasAdminTestJSON-303887283 None] Lock "cinder-f923542b-747a-4b6d-b082-96e32bf3e357-delete_volume" released by "delete_volume" :: held 5.833s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38" returned: 0 in 6.811s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:28 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a698da9-be57-4034-ab11-9cf67f30f1ab]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:28 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc Jun 19 04:22:28 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:29 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc" returned: 0 in 1.076s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:29 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:22:29 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Converted 1024.00 MB image at 150.32 MB/s Jun 19 04:22:29 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38 is being set with open permissions: ugo+rw Jun 19 04:22:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:29 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38 Jun 19 04:22:29 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:29 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Flow 'volume_create_manager' (bb3cf227-c66c-4b57-9dcd-f3c523376167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30054d6f-8f10-4691-96fe-0cb339c6f22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30054d6f-8f10-4691-96fe-0cb339c6f22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-857384532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a592cd9-15ab-4f69-8c4a-8fa7539298c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a513db5ff64f35b5b2a9a58de0bc58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:30Z,use_quota=True,user_id='87748cd911f54689a8d839b231316477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce578105-72cd-4459-89cd-c624c306894a),volume_type_id=ce578105-72cd-4459-89cd-c624c306894a)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a156cb-c3e8-408c-a1a8-48fc118f6671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a156cb-c3e8-408c-a1a8-48fc118f6671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef789cb2-5011-4839-a2f9-df5e86210078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef789cb2-5011-4839-a2f9-df5e86210078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a592cd9-15ab-4f69-8c4a-8fa7539298c5', 'volume_name': 'volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf22b6c-6b16-4ef6-9a05-5fd0cf695d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf22b6c-6b16-4ef6-9a05-5fd0cf695d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfed3147-11a3-44e2-afb4-f9463be62c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:30 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Volume 7a592cd9-15ab-4f69-8c4a-8fa7539298c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5', 'volume_size': 1} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:30 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38" returned: 0 in 0.842s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-67e8ae9d-d59b-4bdf-b577-08312b41dd38" released by "_copy_volume_from_snapshot" :: held 11.609s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-dbf3dd89-81a5-4537-be19-b83c8174d05e-67e8ae9d-d59b-4bdf-b577-08312b41dd38" released by "_create_volume_from_snapshot" :: held 11.679s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.717s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.088s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-857384532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a592cd9-15ab-4f69-8c4a-8fa7539298c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a513db5ff64f35b5b2a9a58de0bc58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:30Z,use_quota=True,user_id='87748cd911f54689a8d839b231316477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce578105-72cd-4459-89cd-c624c306894a),volume_type_id=ce578105-72cd-4459-89cd-c624c306894a)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Creating volume 7a592cd9-15ab-4f69-8c4a-8fa7539298c5 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:30 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:30 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5 1073741824 Jun 19 04:22:30 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935633f3-d77c-4dd6-8b0f-c6c07493a253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38', 'volume_size': 1, 'snapshot_id': 'dbf3dd89-81a5-4537-be19-b83c8174d05e'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7af432d-4579-44eb-abff-64a6eb98ee2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:30 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Volume volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38 (67e8ae9d-d59b-4bdf-b577-08312b41dd38): created successfully Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7af432d-4579-44eb-abff-64a6eb98ee2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Flow 'volume_create_manager' (d840af0b-e720-4f82-85e9-351f03289b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:30 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-59df8124-0307-44e6-ab1d-a7f338a3644a tempest-VolumesSnapshotTestJSON-1029927790 None] Created volume successfully. Jun 19 04:22:31 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5 1073741824" returned: 0 in 0.987s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-67e8ae9d-d59b-4bdf-b577-08312b41dd38-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-67e8ae9d-d59b-4bdf-b577-08312b41dd38-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:31 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5 Jun 19 04:22:31 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-67e8ae9d-d59b-4bdf-b577-08312b41dd38" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-67e8ae9d-d59b-4bdf-b577-08312b41dd38" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:31 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[660fc688-3cf1-4c61-8175-fcc924f70cb3]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:31 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38 Jun 19 04:22:31 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:32 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5" returned: 0 in 0.875s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfed3147-11a3-44e2-afb4-f9463be62c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9ec06d-3f28-4860-a1a3-56001dfafc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:32 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Volume volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5 (7a592cd9-15ab-4f69-8c4a-8fa7539298c5): created successfully Jun 19 04:22:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9ec06d-3f28-4860-a1a3-56001dfafc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Flow 'volume_create_manager' (bb3cf227-c66c-4b57-9dcd-f3c523376167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:32 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-9addffe6-b42f-42fd-a707-bd8c3882105f tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Created volume successfully. Jun 19 04:22:32 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38" returned: 0 in 0.967s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:32 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38 Jun 19 04:22:32 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:33 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-67e8ae9d-d59b-4bdf-b577-08312b41dd38" returned: 0 in 0.787s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-67e8ae9d-d59b-4bdf-b577-08312b41dd38" released by "delete_volume" :: held 1.822s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Created reservations ['592c46e7-1c36-4f4d-bf35-46f792678e65', '516da935-20e1-41a2-ae1b-8f49317aec00', 'f9a7e792-2f25-499a-8936-062ebb4c24b9', '8d297adf-3874-4afa-9f06-8c04b5416602'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:33 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:22:33 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-dbf3dd89-81a5-4537-be19-b83c8174d05e-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-dbf3dd89-81a5-4537-be19-b83c8174d05e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-23f2578e-ac40-4f65-87a5-86f1c3d577bc" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-23f2578e-ac40-4f65-87a5-86f1c3d577bc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-dbf3dd89-81a5-4537-be19-b83c8174d05e" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-dbf3dd89-81a5-4537-be19-b83c8174d05e" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Deleting offline snapshot dbf3dd89-81a5-4537-be19-b83c8174d05e of volume 23f2578e-ac40-4f65-87a5-86f1c3d577bc {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] snapshot_file for this snap is: volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[548c8b46-063b-4041-8740-2ecc9128e78e]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:34 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e Jun 19 04:22:34 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-295bc2dd-c816-4f81-825b-85bb3861a51e tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-295bc2dd-c816-4f81-825b-85bb3861a51e tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-295bc2dd-c816-4f81-825b-85bb3861a51e tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-295bc2dd-c816-4f81-825b-85bb3861a51e tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-295bc2dd-c816-4f81-825b-85bb3861a51e tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-295bc2dd-c816-4f81-825b-85bb3861a51e tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:34 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:22:34 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:34 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.222s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:34 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:34 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Deleted volume successfully. Jun 19 04:22:34 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-44dd5136-ed6d-471f-8084-e5b6ceb53a0e tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-67e8ae9d-d59b-4bdf-b577-08312b41dd38-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:35 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-295bc2dd-c816-4f81-825b-85bb3861a51e tempest-VolumeRetypeWithoutMigrationTest-510342175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.149s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:35 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-295bc2dd-c816-4f81-825b-85bb3861a51e tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:35 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-295bc2dd-c816-4f81-825b-85bb3861a51e tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Retype volume completed successfully. Jun 19 04:22:35 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Acquiring lock "cinder-7a592cd9-15ab-4f69-8c4a-8fa7539298c5-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:35 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e" returned: 0 in 1.492s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:22:35 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Lock "cinder-7a592cd9-15ab-4f69-8c4a-8fa7539298c5-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:35 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b621a80-1814-42ee-bc63-a22855aed4e6]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:35 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Acquiring lock "cinder-quobyte-7a592cd9-15ab-4f69-8c4a-8fa7539298c5" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:35 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Lock "cinder-quobyte-7a592cd9-15ab-4f69-8c4a-8fa7539298c5" acquired by "delete_volume" :: waited 0.036s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:35 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5739b378-5aee-4cff-8df0-7ba565bf4c35]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:35 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc Jun 19 04:22:35 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:35 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5 Jun 19 04:22:35 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:36 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc" returned: 0 in 1.084s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:36 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e Jun 19 04:22:36 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Flow 'volume_create_manager' (01388a82-8ece-43aa-8ded-0981fe849928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a42748-248c-46ca-ac23-7eff210393a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a42748-248c-46ca-ac23-7eff210393a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-482466239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0778e41a-3a00-4cff-aa00-ff1f9b4882c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e118f464d7ca44f9af83714c733bc7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:36Z,use_quota=True,user_id='752aad2eaa294da3955eab2cb39585f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783f8c87-a5fa-46f3-b248-1063818a38ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783f8c87-a5fa-46f3-b248-1063818a38ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c54e08-812b-4929-9f9a-6fe9c5b32bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c54e08-812b-4929-9f9a-6fe9c5b32bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0778e41a-3a00-4cff-aa00-ff1f9b4882c4', 'volume_name': 'volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3a2c87-a788-4ea5-bf6e-adae0b09f4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3a2c87-a788-4ea5-bf6e-adae0b09f4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8f2825-80ca-453f-93e2-8c76e13ddd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Volume 0778e41a-3a00-4cff-aa00-ff1f9b4882c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4', 'volume_size': 1} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-482466239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0778e41a-3a00-4cff-aa00-ff1f9b4882c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e118f464d7ca44f9af83714c733bc7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:36Z,use_quota=True,user_id='752aad2eaa294da3955eab2cb39585f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Creating volume 0778e41a-3a00-4cff-aa00-ff1f9b4882c4 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:36 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:36 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4 1073741824 Jun 19 04:22:36 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:36 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5" returned: 0 in 1.234s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:36 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5 Jun 19 04:22:36 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:37 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e" returned: 0 in 0.862s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:37 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e Jun 19 04:22:37 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:37 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7a592cd9-15ab-4f69-8c4a-8fa7539298c5" returned: 0 in 0.807s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:37 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Lock "cinder-quobyte-7a592cd9-15ab-4f69-8c4a-8fa7539298c5" released by "delete_volume" :: held 2.101s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:37 devstack cinder-volume[93300]: WARNING cinder.quota [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:22:37 devstack cinder-volume[93300]: WARNING cinder.quota [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:22:37 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Created reservations ['43810d69-f8b8-44f5-be04-0b02c5012c06', '2cf7a1b5-8523-4820-9d74-37020cfb8657', 'cf31802d-83ec-40df-a9e1-2fe45aa1653f', '3ca9622e-a134-4102-b072-c0d7614793aa'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:37 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4 1073741824" returned: 0 in 1.238s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:37 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:22:37 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:37 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4 Jun 19 04:22:37 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:38 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc.dbf3dd89-81a5-4537-be19-b83c8174d05e" returned: 0 in 0.761s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-dbf3dd89-81a5-4537-be19-b83c8174d05e" released by "_delete_snapshot" :: held 4.425s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-23f2578e-ac40-4f65-87a5-86f1c3d577bc" released by "delete_snapshot" :: held 4.477s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Created reservations ['86760a65-c850-493a-b5d0-fc5715314021', '64ba1077-c011-44cd-b573-9d4f7dab88ad', '0f68cf22-45ec-414f-8c38-8f8eb6a35d19', '279ba3a9-6aa4-43aa-b90e-0300b9870b3e'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:38 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Delete snapshot completed successfully. Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-500aa47a-1c9b-4947-b159-81c9d1f56ab6 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-dbf3dd89-81a5-4537-be19-b83c8174d05e-delete_snapshot" released by "delete_snapshot" :: held 4.675s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:38 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.673s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:38 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Deleted volume successfully. Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0f31b17b-669d-4b03-889c-995e04c7f051 tempest-VolumeRetypeWithoutMigrationTest-510342175 None] Lock "cinder-7a592cd9-15ab-4f69-8c4a-8fa7539298c5-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:38 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4" returned: 0 in 0.774s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8f2825-80ca-453f-93e2-8c76e13ddd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4649834b-9c8d-42c0-a8fd-ad65649fb4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:38 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Volume volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4 (0778e41a-3a00-4cff-aa00-ff1f9b4882c4): created successfully Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4649834b-9c8d-42c0-a8fd-ad65649fb4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Flow 'volume_create_manager' (01388a82-8ece-43aa-8ded-0981fe849928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:38 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8ba729f5-409d-45cb-bbe5-29fcf6bed894 tempest-VolumesServicesTestJSON-1626567449 None] Created volume successfully. Jun 19 04:22:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-23f2578e-ac40-4f65-87a5-86f1c3d577bc-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-23f2578e-ac40-4f65-87a5-86f1c3d577bc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-23f2578e-ac40-4f65-87a5-86f1c3d577bc" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-23f2578e-ac40-4f65-87a5-86f1c3d577bc" acquired by "delete_volume" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:39 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ea1c85-32a2-430e-a83c-d0465d34ca9a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:39 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc Jun 19 04:22:39 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Acquiring lock "cinder-0778e41a-3a00-4cff-aa00-ff1f9b4882c4-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Lock "cinder-0778e41a-3a00-4cff-aa00-ff1f9b4882c4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Acquiring lock "cinder-quobyte-0778e41a-3a00-4cff-aa00-ff1f9b4882c4" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Lock "cinder-quobyte-0778e41a-3a00-4cff-aa00-ff1f9b4882c4" acquired by "delete_volume" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:39 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5de607-0cc5-4116-aba9-6bd49492ca4e]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:40 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc" returned: 0 in 0.956s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:40 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4 Jun 19 04:22:40 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:40 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc Jun 19 04:22:40 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:40 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4" returned: 0 in 0.859s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:40 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-23f2578e-ac40-4f65-87a5-86f1c3d577bc" returned: 0 in 0.744s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:40 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4 Jun 19 04:22:40 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-23f2578e-ac40-4f65-87a5-86f1c3d577bc" released by "delete_volume" :: held 1.769s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:40 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Created reservations ['8dd20bf8-5ba1-4aab-b242-28a335b1ddb4', '080fe7b5-2c03-4939-8802-06d81a78cb88', 'ed2cbad3-b4be-408d-b015-a9dfa6d22b5c', '2c170f19-5068-404c-bf85-e40c6174b5df'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:41 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:22:41 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-a93c3549-8cd3-4194-a5bb-25e928a9b332-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-a93c3549-8cd3-4194-a5bb-25e928a9b332-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "cinder-quobyte-a93c3549-8cd3-4194-a5bb-25e928a9b332" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-a93c3549-8cd3-4194-a5bb-25e928a9b332" acquired by "delete_volume" :: waited 0.034s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[993355f7-31fa-4890-bcbe-712d6a5bec28]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:41 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0778e41a-3a00-4cff-aa00-ff1f9b4882c4" returned: 0 in 0.960s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Lock "cinder-quobyte-0778e41a-3a00-4cff-aa00-ff1f9b4882c4" released by "delete_volume" :: held 1.886s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:41 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 Jun 19 04:22:41 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:41 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Created reservations ['f764df09-acd6-4b57-b445-1118a13a1902', 'f8bce210-5ece-4c3d-8ccb-ddd81d2d647f', '9dd27037-3d5a-4e92-829a-d6b7b02dd87b', 'ee1d7d67-4a56-4ae6-9143-1ad48590c76e'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:42 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:22:42 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:42 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.457s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:42 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:42 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Deleted volume successfully. Jun 19 04:22:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4e5644bc-2fa9-4042-a4ee-a273a27c1fb8 tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-23f2578e-ac40-4f65-87a5-86f1c3d577bc-delete_volume" released by "delete_volume" :: held 3.597s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:43 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.449s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:43 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:43 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Deleted volume successfully. Jun 19 04:22:43 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332" returned: 0 in 1.891s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0b49a7ed-f802-43c2-8a57-1cb55a2d6d5a tempest-VolumesServicesTestJSON-1626567449 None] Lock "cinder-0778e41a-3a00-4cff-aa00-ff1f9b4882c4-delete_volume" released by "delete_volume" :: held 3.813s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:43 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332 Jun 19 04:22:43 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:45 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a93c3549-8cd3-4194-a5bb-25e928a9b332" returned: 0 in 1.425s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-quobyte-a93c3549-8cd3-4194-a5bb-25e928a9b332" released by "delete_volume" :: held 3.431s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:45 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Created reservations ['468914f6-c673-4e43-8658-19a01554eaf6', '4d8a42f0-443a-49ec-aefa-887909dbb89e', 'c4dd1bb9-6796-449d-a355-1b149f923850', '7ee0c55b-e178-4818-a403-3eb6897795d8'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:45 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:22:45 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:46 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.194s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:46 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:46 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Deleted volume successfully. Jun 19 04:22:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83ee2c91-70d7-4c37-91d1-5f7adf9ef74d tempest-VolumesSnapshotTestJSON-1029927790 None] Lock "cinder-a93c3549-8cd3-4194-a5bb-25e928a9b332-delete_volume" released by "delete_volume" :: held 4.940s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e4396b39-ba8d-4cee-b47b-fa436308a264 tempest-VolumesActionsTest-1931475445 None] Acquiring lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800" by "attach_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e4396b39-ba8d-4cee-b47b-fa436308a264 tempest-VolumesActionsTest-1931475445 None] Lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800" acquired by "attach_volume" :: waited 0.035s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:47 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e4396b39-ba8d-4cee-b47b-fa436308a264 tempest-VolumesActionsTest-1931475445 None] Attaching volume 8a47386d-d77f-4ee1-a747-7d07b7fba800 to instance 438d5867-41d5-47cf-a3b4-786b29b2c895 at mountpoint /dev/vdb on host None. Jun 19 04:22:47 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e4396b39-ba8d-4cee-b47b-fa436308a264 tempest-VolumesActionsTest-1931475445 None] Attach volume completed successfully. Jun 19 04:22:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e4396b39-ba8d-4cee-b47b-fa436308a264 tempest-VolumesActionsTest-1931475445 None] Lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800" released by "attach_volume" :: held 0.164s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-52fb347d-11a2-4b1d-a017-c227233c5dd5 tempest-VolumesActionsTest-1931475445 None] Acquiring lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800-detach_volume" by "detach_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-52fb347d-11a2-4b1d-a017-c227233c5dd5 tempest-VolumesActionsTest-1931475445 None] Lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:48 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-52fb347d-11a2-4b1d-a017-c227233c5dd5 tempest-VolumesActionsTest-1931475445 None] Detaching volume 8a47386d-d77f-4ee1-a747-7d07b7fba800 from instance 438d5867-41d5-47cf-a3b4-786b29b2c895. Jun 19 04:22:48 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-52fb347d-11a2-4b1d-a017-c227233c5dd5 tempest-VolumesActionsTest-1931475445 None] Detach volume completed successfully. Jun 19 04:22:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-52fb347d-11a2-4b1d-a017-c227233c5dd5 tempest-VolumesActionsTest-1931475445 None] Lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:58 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=50,cinder:INSERT=14,cinder:UPDATE=70,cinder:DELETE=2 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:22:58 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=53,cinder:INSERT=18,cinder:UPDATE=66,cinder:DELETE=7 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:22:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:59 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bbf69d-d9ec-41d7-b1b2-835ef5e704db]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:59 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 Jun 19 04:22:59 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:00 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800" returned: 0 in 0.946s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:00 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bd12e5-7938-40be-9e3d-d75a5318942a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:00 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 Jun 19 04:23:00 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:01 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800" returned: 0 in 0.995s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.ccbecd71-dc7f-4867-96be-967c54eee5e8r1ho1inj.img {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:01 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.ccbecd71-dc7f-4867-96be-967c54eee5e8r1ho1inj.img Jun 19 04:23:01 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:08 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.ccbecd71-dc7f-4867-96be-967c54eee5e8r1ho1inj.img" returned: 0 in 6.811s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:08 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[272454f6-7501-4105-887a-93b0f2b9a87b]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:08 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 Jun 19 04:23:08 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:09 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=1 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:23:09 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=2 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:23:09 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800" returned: 0 in 1.435s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:09 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.ccbecd71-dc7f-4867-96be-967c54eee5e8r1ho1inj.img {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:23:09 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] Converted 1024.00 MB image at 150.29 MB/s Jun 19 04:23:09 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] ccbecd71-dc7f-4867-96be-967c54eee5e8 was raw, no need to convert to raw {{(pid=93300) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 19 04:23:10 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Flow 'volume_create_manager' (62c3deb4-ac39-4a6f-b09d-21dca67eb93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d84e8e-91ed-4d05-bea4-054ba0b63226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d84e8e-91ed-4d05-bea4-054ba0b63226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-675524459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66d7d13-ee26-419f-879d-6f8680ede565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0063fa1328fb444aa54f57d2a6d3ed61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:11Z,use_quota=True,user_id='945dec50ddf747dd8c1972a026fbb551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa5a92b-0f99-4f85-a95e-c6a6019f9e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa5a92b-0f99-4f85-a95e-c6a6019f9e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57c192c-be6b-4306-9ed6-29e271e1fed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57c192c-be6b-4306-9ed6-29e271e1fed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b66d7d13-ee26-419f-879d-6f8680ede565', 'volume_name': 'volume-b66d7d13-ee26-419f-879d-6f8680ede565', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31471ab1-8854-4396-897f-cd8ec1ae03db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31471ab1-8854-4396-897f-cd8ec1ae03db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cef5a78-4ffe-4969-9ab0-6a7898a17c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:10 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Volume b66d7d13-ee26-419f-879d-6f8680ede565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b66d7d13-ee26-419f-879d-6f8680ede565', 'volume_size': 1} Jun 19 04:23:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:16 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Flow 'volume_create_manager' (605385f8-3052-4424-8b46-3fd9d5698cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7da027-fdfa-44f0-a555-45fb076de460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7da027-fdfa-44f0-a555-45fb076de460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-878796769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f82eee-6ef6-48af-b623-cfe96851cf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700a4bde2e3c45dda02a83e7f4b0a3f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:17Z,use_quota=True,user_id='ea63230d391f4371b9c634d55822b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e82320f-7a27-4521-b589-cb886c8ccf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e82320f-7a27-4521-b589-cb886c8ccf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4485b16-7e2e-47fa-ad37-63b3e477fbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4485b16-7e2e-47fa-ad37-63b3e477fbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f82eee-6ef6-48af-b623-cfe96851cf78', 'volume_name': 'volume-35f82eee-6ef6-48af-b623-cfe96851cf78', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8515bece-29c8-4a13-bbcd-0a72d7de6d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8515bece-29c8-4a13-bbcd-0a72d7de6d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9c5a8c-c6bd-470f-a62f-83e78118f722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:16 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Volume 35f82eee-6ef6-48af-b623-cfe96851cf78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f82eee-6ef6-48af-b623-cfe96851cf78', 'volume_size': 1} Jun 19 04:23:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:23:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:19 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:23:19 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:20 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.954s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:20 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:23:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 28 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:23:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:23:26 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:23:26 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=5 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Flow 'volume_create_manager' (98487eba-30f8-49ad-a764-8342333fc27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693f333c-55f9-4f79-84b6-66acdf279187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693f333c-55f9-4f79-84b6-66acdf279187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1796374422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77eb6e3d-9ba7-46ae-9111-8b896b3597c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fbe97571f984bf6b1d7b812d6d23863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:28Z,use_quota=True,user_id='8763cd655e26405795436b7c2d1585b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bf4b25c-fcab-4da7-a02e-a66f3741b5d4),volume_type_id=5bf4b25c-fcab-4da7-a02e-a66f3741b5d4)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5ec476-65a8-40a8-bb76-58683a1fcb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5ec476-65a8-40a8-bb76-58683a1fcb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a770e822-ec71-4e25-a3e6-b283ffbf8331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a770e822-ec71-4e25-a3e6-b283ffbf8331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77eb6e3d-9ba7-46ae-9111-8b896b3597c5', 'volume_name': 'volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b86ea2a-518d-4c6e-8c88-a0f2f0a889b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b86ea2a-518d-4c6e-8c88-a0f2f0a889b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715e1af7-b402-4e78-90b7-f8a30d89af8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:28 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Volume 77eb6e3d-9ba7-46ae-9111-8b896b3597c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5', 'volume_size': 1} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Flow 'volume_create_manager' (6edaf1cc-fac3-4591-b519-c982a89ef602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c4482e-d716-4319-949d-19a7fb520201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c4482e-d716-4319-949d-19a7fb520201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1410192416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055696c1-263f-4496-85e2-6b7e55b34d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fbe97571f984bf6b1d7b812d6d23863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:28Z,use_quota=True,user_id='8763cd655e26405795436b7c2d1585b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a2652f-fc29-464a-b273-6afcf857a521),volume_type_id=79a2652f-fc29-464a-b273-6afcf857a521)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3eb605-c97c-4f10-beca-6f8a86d13cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3eb605-c97c-4f10-beca-6f8a86d13cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ac52d7-ee15-4605-9eca-4ec1f8561323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ac52d7-ee15-4605-9eca-4ec1f8561323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '055696c1-263f-4496-85e2-6b7e55b34d0d', 'volume_name': 'volume-055696c1-263f-4496-85e2-6b7e55b34d0d', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e23812d-6c42-4fa7-93c1-2da7e6fde31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e23812d-6c42-4fa7-93c1-2da7e6fde31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfb7998-cebe-489a-8e68-e5dc203e9aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:28 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Volume 055696c1-263f-4496-85e2-6b7e55b34d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-055696c1-263f-4496-85e2-6b7e55b34d0d', 'volume_size': 1} Jun 19 04:23:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:29 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Flow 'volume_create_manager' (939650ef-df0b-4ab8-88d6-69316bf2e0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2b5dd1-df8d-4a85-8b6f-d76af38822da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2b5dd1-df8d-4a85-8b6f-d76af38822da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-811106194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff87c49-0cad-4213-ba34-c1107b2e1909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fbe97571f984bf6b1d7b812d6d23863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:29Z,use_quota=True,user_id='8763cd655e26405795436b7c2d1585b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea88edbe-a6a7-46b3-be4c-7ebe51230dd4),volume_type_id=ea88edbe-a6a7-46b3-be4c-7ebe51230dd4)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4703bb1f-1b83-452f-b894-a3c5c80d0479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4703bb1f-1b83-452f-b894-a3c5c80d0479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7934cc3f-beb5-4644-acf4-18fb520319f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:29 devstack cinder-volume[93300]: DEBUG cinder.image.glance [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Creating Keystone auth plugin from conf {{(pid=93300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:23:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7934cc3f-beb5-4644-acf4-18fb520319f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ff87c49-0cad-4213-ba34-c1107b2e1909', 'volume_name': 'volume-0ff87c49-0cad-4213-ba34-c1107b2e1909', 'volume_size': 1, 'image_id': '2ce391f0-9c46-48a6-b7b5-c03fa61880a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ce391f0-9c46-48a6-b7b5-c03fa61880a0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1351746967', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9fbe97571f984bf6b1d7b812d6d23863', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2ce391f0-9c46-48a6-b7b5-c03fa61880a0', 'created_at': datetime.datetime(2026, 6, 19, 2, 23, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 23, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ce391f0-9c46-48a6-b7b5-c03fa61880a0/file', 'properties': {}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185a7f37-c91e-4732-b576-969c3a095db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185a7f37-c91e-4732-b576-969c3a095db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b10d09-d376-4cb5-9d6a-455329adf60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:29 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Volume 0ff87c49-0cad-4213-ba34-c1107b2e1909: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ff87c49-0cad-4213-ba34-c1107b2e1909', 'volume_size': 1, 'image_id': '2ce391f0-9c46-48a6-b7b5-c03fa61880a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ce391f0-9c46-48a6-b7b5-c03fa61880a0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1351746967', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9fbe97571f984bf6b1d7b812d6d23863', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2ce391f0-9c46-48a6-b7b5-c03fa61880a0', 'created_at': datetime.datetime(2026, 6, 19, 2, 23, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 23, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ce391f0-9c46-48a6-b7b5-c03fa61880a0/file', 'properties': {}}, 'image_service': } Jun 19 04:23:29 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Trying to clone 0ff87c49-0cad-4213-ba34-c1107b2e1909 from image 2ce391f0-9c46-48a6-b7b5-c03fa61880a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2ce391f0-9c46-48a6-b7b5-c03fa61880a0', 'metadata': {}}]). {{(pid=93300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:23:33 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD, size 20.69 MB, duration 4.08 sec {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:23:33 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Image download 20.69 MB at 5.07 MB/s Jun 19 04:23:33 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff02e0f-67aa-4a59-9731-62f88e482458]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:33 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD Jun 19 04:23:33 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.304s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] Uploaded volume to glance image-id: ccbecd71-dc7f-4867-96be-967c54eee5e8. {{(pid=93300) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.071s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-675524459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66d7d13-ee26-419f-879d-6f8680ede565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0063fa1328fb444aa54f57d2a6d3ed61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:11Z,use_quota=True,user_id='945dec50ddf747dd8c1972a026fbb551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Creating volume b66d7d13-ee26-419f-879d-6f8680ede565 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:34 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:34 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 1073741824 Jun 19 04:23:34 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:34 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-17e1d806-f46d-4d29-a2ce-0443d35f695c tempest-VolumesActionsTest-1931475445 None] Copy volume to image completed successfully. Jun 19 04:23:34 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD" returned: 0 in 0.769s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Temporary image 2ce391f0-9c46-48a6-b7b5-c03fa61880a0 is fetched for user 8763cd655e26405795436b7c2d1585b5. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cee6eda-e1d4-48fe-9ab9-13145b6e3280]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:34 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD Jun 19 04:23:34 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:34 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 1073741824" returned: 0 in 0.959s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:35 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 Jun 19 04:23:35 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:35 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD" returned: 0 in 0.779s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:35 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565" returned: 0 in 0.676s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.845s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-878796769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f82eee-6ef6-48af-b623-cfe96851cf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700a4bde2e3c45dda02a83e7f4b0a3f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:17Z,use_quota=True,user_id='ea63230d391f4371b9c634d55822b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Creating volume 35f82eee-6ef6-48af-b623-cfe96851cf78 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:35 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-35f82eee-6ef6-48af-b623-cfe96851cf78 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:35 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-35f82eee-6ef6-48af-b623-cfe96851cf78 1073741824 Jun 19 04:23:35 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cef5a78-4ffe-4969-9ab0-6a7898a17c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b66d7d13-ee26-419f-879d-6f8680ede565', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb63df1-8177-4189-8de9-4bc0ba1d32fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:35 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Volume volume-b66d7d13-ee26-419f-879d-6f8680ede565 (b66d7d13-ee26-419f-879d-6f8680ede565): created successfully Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb63df1-8177-4189-8de9-4bc0ba1d32fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Flow 'volume_create_manager' (62c3deb4-ac39-4a6f-b09d-21dca67eb93e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:35 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-62625d12-1a0d-4829-b690-d9b34fe9d45f tempest-VolumesDeleteCascade-1286972204 None] Created volume successfully. Jun 19 04:23:36 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-35f82eee-6ef6-48af-b623-cfe96851cf78 1073741824" returned: 0 in 0.778s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-35f82eee-6ef6-48af-b623-cfe96851cf78 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:36 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-35f82eee-6ef6-48af-b623-cfe96851cf78 Jun 19 04:23:36 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:37 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-35f82eee-6ef6-48af-b623-cfe96851cf78" returned: 0 in 0.639s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1796374422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77eb6e3d-9ba7-46ae-9111-8b896b3597c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fbe97571f984bf6b1d7b812d6d23863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:28Z,use_quota=True,user_id='8763cd655e26405795436b7c2d1585b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bf4b25c-fcab-4da7-a02e-a66f3741b5d4),volume_type_id=5bf4b25c-fcab-4da7-a02e-a66f3741b5d4)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Creating volume 77eb6e3d-9ba7-46ae-9111-8b896b3597c5 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:37 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9c5a8c-c6bd-470f-a62f-83e78118f722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f82eee-6ef6-48af-b623-cfe96851cf78', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04330d4-9833-4e0f-88a0-58ef51fce87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:37 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5 1073741824 Jun 19 04:23:37 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:37 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Volume volume-35f82eee-6ef6-48af-b623-cfe96851cf78 (35f82eee-6ef6-48af-b623-cfe96851cf78): created successfully Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04330d4-9833-4e0f-88a0-58ef51fce87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Flow 'volume_create_manager' (605385f8-3052-4424-8b46-3fd9d5698cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:37 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2b00ca2b-8502-4de4-9b22-442aa8755bd7 tempest-VolumesListAdminTestJSON-473824112 None] Created volume successfully. Jun 19 04:23:38 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5 1073741824" returned: 0 in 0.834s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:38 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5 Jun 19 04:23:38 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Flow 'volume_create_manager' (185e5e64-5daf-471a-9249-3030db34e0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8537a2a2-1cbf-4971-ad5f-793ecdeba330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8537a2a2-1cbf-4971-ad5f-793ecdeba330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1692354980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505f3304-44c3-435f-b314-e902374fd17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700a4bde2e3c45dda02a83e7f4b0a3f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:39Z,use_quota=True,user_id='ea63230d391f4371b9c634d55822b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9f56e0-1ddd-4e26-b50c-cdfc608ceecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9f56e0-1ddd-4e26-b50c-cdfc608ceecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1070c9-90e5-4759-b9f2-7df4335e7492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1070c9-90e5-4759-b9f2-7df4335e7492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '505f3304-44c3-435f-b314-e902374fd17a', 'volume_name': 'volume-505f3304-44c3-435f-b314-e902374fd17a', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06e25a5-cb38-41a4-8634-0ec7475cd32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06e25a5-cb38-41a4-8634-0ec7475cd32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88aa0035-6cee-487b-a8d3-22ca564915a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:39 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Volume 505f3304-44c3-435f-b314-e902374fd17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-505f3304-44c3-435f-b314-e902374fd17a', 'volume_size': 1} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:39 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5" returned: 0 in 0.645s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.723s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1410192416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055696c1-263f-4496-85e2-6b7e55b34d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fbe97571f984bf6b1d7b812d6d23863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:28Z,use_quota=True,user_id='8763cd655e26405795436b7c2d1585b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a2652f-fc29-464a-b273-6afcf857a521),volume_type_id=79a2652f-fc29-464a-b273-6afcf857a521)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Creating volume 055696c1-263f-4496-85e2-6b7e55b34d0d {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:39 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:39 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d 1073741824 Jun 19 04:23:39 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715e1af7-b402-4e78-90b7-f8a30d89af8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61a2c03-f814-4073-b53a-e28b31fc370e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:39 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Volume volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5 (77eb6e3d-9ba7-46ae-9111-8b896b3597c5): created successfully Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61a2c03-f814-4073-b53a-e28b31fc370e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Flow 'volume_create_manager' (98487eba-30f8-49ad-a764-8342333fc27e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:39 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f8b05bc3-47c4-4a7a-b681-e07b4e4f511c tempest-TestInstancesWithCinderVolumes-921932341 None] Created volume successfully. Jun 19 04:23:40 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d 1073741824" returned: 0 in 0.831s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:40 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d Jun 19 04:23:40 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:40 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d" returned: 0 in 0.713s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:23:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.703s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:40 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ea9fb5-c3dc-4a4c-8e15-2d78b8930775]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfb7998-cebe-489a-8e68-e5dc203e9aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-055696c1-263f-4496-85e2-6b7e55b34d0d', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a327f66-8882-45b7-941f-030596393b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:40 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Volume volume-055696c1-263f-4496-85e2-6b7e55b34d0d (055696c1-263f-4496-85e2-6b7e55b34d0d): created successfully Jun 19 04:23:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a327f66-8882-45b7-941f-030596393b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Flow 'volume_create_manager' (6edaf1cc-fac3-4591-b519-c982a89ef602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:40 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-cc87ca4e-747d-468b-a086-6c485b04f812 tempest-TestInstancesWithCinderVolumes-921932341 None] Created volume successfully. Jun 19 04:23:41 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 Jun 19 04:23:41 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:41 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800" returned: 0 in 0.763s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:41 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[521658c8-6207-4cbe-aa65-834e438f5c58]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:41 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 Jun 19 04:23:41 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:42 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800" returned: 0 in 0.715s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:42 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img Jun 19 04:23:42 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:46 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img" returned: 0 in 4.128s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:46 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0012e39-5353-483e-b06e-fd918940868d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:46 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 Jun 19 04:23:46 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:47 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800" returned: 0 in 0.898s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:47 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800, size 1024.00 MB, duration 4.13 sec, destination /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:23:47 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Converted 1024.00 MB image at 248.00 MB/s Jun 19 04:23:47 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] 32e74f0f-cbd1-4de5-8455-938b980dcd2b was raw, converting to qcow2 {{(pid=93300) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 19 04:23:47 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b48da40-16c0-403e-a6e4-f98c4c4712d1]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:47 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img Jun 19 04:23:47 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:48 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img" returned: 0 in 0.698s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:48 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img Jun 19 04:23:48 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:48 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img" returned: 1 in 0.681s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:23:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img /opt/stack/data/cinder/conversion/vol_upload__zsld_i5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:48 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img /opt/stack/data/cinder/conversion/vol_upload__zsld_i5 Jun 19 04:23:48 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:49 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img /opt/stack/data/cinder/conversion/vol_upload__zsld_i5" returned: 0 in 0.617s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:49 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Image conversion details: src /opt/stack/data/cinder/conversion/8a47386d-d77f-4ee1-a747-7d07b7fba800.temp_image.32e74f0f-cbd1-4de5-8455-938b980dcd2b687zj56g.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__zsld_i5 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:23:49 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 19 04:23:49 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c70c418-d253-4f54-9499-4f5df5c9786a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__zsld_i5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:49 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__zsld_i5 Jun 19 04:23:49 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:50 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__zsld_i5" returned: 0 in 0.682s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.614s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Uploaded volume to glance image-id: 32e74f0f-cbd1-4de5-8455-938b980dcd2b. {{(pid=93300) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 19 04:23:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.177s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-811106194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff87c49-0cad-4213-ba34-c1107b2e1909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fbe97571f984bf6b1d7b812d6d23863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:29Z,use_quota=True,user_id='8763cd655e26405795436b7c2d1585b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea88edbe-a6a7-46b3-be4c-7ebe51230dd4),volume_type_id=ea88edbe-a6a7-46b3-be4c-7ebe51230dd4)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:23:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Creating volume 0ff87c49-0cad-4213-ba34-c1107b2e1909 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:23:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:51 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:23:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:51 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 1073741824 Jun 19 04:23:51 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:51 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-fea4a48a-20f5-4af9-9698-6fb66daf5c4e tempest-VolumesActionsTest-1931475445 None] Copy volume to image completed successfully. Jun 19 04:23:52 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 1073741824" returned: 0 in 0.839s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:52 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 Jun 19 04:23:52 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Acquiring lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Acquiring lock "cinder-quobyte-8a47386d-d77f-4ee1-a747-7d07b7fba800" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Lock "cinder-quobyte-8a47386d-d77f-4ee1-a747-7d07b7fba800" acquired by "delete_volume" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:52 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00b7aaa-ec83-47a0-8128-bf178abb95bc]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:52 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 Jun 19 04:23:52 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:53 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909" returned: 0 in 0.659s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.061s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] Creating offline snapshot 8ee71037-30e9-425d-bd81-ef01e1326f8d of volume b66d7d13-ee26-419f-879d-6f8680ede565 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Attempting download of 2ce391f0-9c46-48a6-b7b5-c03fa61880a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ce391f0-9c46-48a6-b7b5-c03fa61880a0', 'metadata': {}}])) to volume 0ff87c49-0cad-4213-ba34-c1107b2e1909. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e787a8-5724-4854-8df6-5cc81b569fb4]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7566772e-d115-45de-ae90-fd8fc5a92af9]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_f3vat0cr {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:53 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 Jun 19 04:23:53 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:53 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_f3vat0cr Jun 19 04:23:53 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:53 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800" returned: 0 in 0.765s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:53 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800 Jun 19 04:23:53 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:53 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_f3vat0cr" returned: 0 in 0.724s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_f3vat0cr {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:53 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565" returned: 0 in 0.829s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:53 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d 1G Jun 19 04:23:53 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:53 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_f3vat0cr Jun 19 04:23:53 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:53 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8a47386d-d77f-4ee1-a747-7d07b7fba800" returned: 0 in 0.656s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Lock "cinder-quobyte-8a47386d-d77f-4ee1-a747-7d07b7fba800" released by "delete_volume" :: held 1.463s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Created reservations ['d956f915-b753-4693-967c-663341dd2d36', '4beba55b-0655-4991-8f5d-575aa5b34c6f', '60fec794-b797-4004-8564-c092ff9654c5', '6acf1d62-e0ce-4625-9950-699e343c32d8'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:54 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:23:54 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:54 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_f3vat0cr" returned: 1 in 0.744s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_f3vat0cr' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9efea51-cd3b-4d0d-82b3-0961af7584c4]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:54 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD Jun 19 04:23:54 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:54 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d 1G" returned: 0 in 0.865s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66d7d13-ee26-419f-879d-6f8680ede565 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:54 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.699s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:54 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66d7d13-ee26-419f-879d-6f8680ede565 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d Jun 19 04:23:54 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:54 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Deleted volume successfully. Jun 19 04:23:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ca1fc51c-c2fc-45ca-a113-3580bcd07100 tempest-VolumesActionsTest-1931475445 None] Lock "cinder-8a47386d-d77f-4ee1-a747-7d07b7fba800-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:55 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD" returned: 0 in 0.763s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:55 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] 2ce391f0-9c46-48a6-b7b5-c03fa61880a0 was qcow2, converting to raw {{(pid=93300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:23:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:55 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 Jun 19 04:23:55 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:55 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66d7d13-ee26-419f-879d-6f8680ede565 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d" returned: 0 in 0.788s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:55 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d is being set with open permissions: ugo+rw Jun 19 04:23:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:55 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d Jun 19 04:23:55 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:56 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d" returned: 0 in 0.732s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:56 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.info Jun 19 04:23:56 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:57 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.info" returned: 0 in 0.710s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:57 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.info is being set with open permissions: ugo+rw Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:57 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.info Jun 19 04:23:57 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:57 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909" returned: 0 in 2.188s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2ce391f0-9c46-48a6-b7b5-c03fa61880a0_mp8y5wk1devstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:23:57 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Converted 112.00 MB image at 51.17 MB/s Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:57 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 1G Jun 19 04:23:57 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:57 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.info" returned: 0 in 0.721s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.758s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.683s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1692354980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505f3304-44c3-435f-b314-e902374fd17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700a4bde2e3c45dda02a83e7f4b0a3f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:39Z,use_quota=True,user_id='ea63230d391f4371b9c634d55822b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Creating volume 505f3304-44c3-435f-b314-e902374fd17a {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:57 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:23:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-505f3304-44c3-435f-b314-e902374fd17a 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:57 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-505f3304-44c3-435f-b314-e902374fd17a 1073741824 Jun 19 04:23:57 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:57 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-cca0e172-1c71-479a-bc74-250a31559b98 tempest-VolumesDeleteCascade-1286972204 None] Create snapshot completed successfully Jun 19 04:23:58 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 1G" returned: 0 in 0.760s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:58 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7078268a-17b0-420a-81b6-64a657643c67]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:58 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 Jun 19 04:23:58 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:58 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-505f3304-44c3-435f-b314-e902374fd17a 1073741824" returned: 0 in 1.053s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-505f3304-44c3-435f-b314-e902374fd17a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:58 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-505f3304-44c3-435f-b314-e902374fd17a Jun 19 04:23:58 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:59 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909" returned: 0 in 1.050s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:59 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 Jun 19 04:23:59 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:59 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-505f3304-44c3-435f-b314-e902374fd17a" returned: 0 in 0.914s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.709s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88aa0035-6cee-487b-a8d3-22ca564915a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-505f3304-44c3-435f-b314-e902374fd17a', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d0e3a9-6da1-4838-ac75-fd504c6574bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] Creating offline snapshot f5fd07d9-d13d-4914-95c0-23068077e715 of volume b66d7d13-ee26-419f-879d-6f8680ede565 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:23:59 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Volume volume-505f3304-44c3-435f-b314-e902374fd17a (505f3304-44c3-435f-b314-e902374fd17a): created successfully Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d0e3a9-6da1-4838-ac75-fd504c6574bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Flow 'volume_create_manager' (185e5e64-5daf-471a-9249-3030db34e0c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fdd1c7-ef8a-4071-8c53-f2b07830b648]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:59 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-a9deffa7-18a1-4af6-8042-619bf9582084 tempest-VolumesListAdminTestJSON-473824112 None] Created volume successfully. Jun 19 04:24:00 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d Jun 19 04:24:00 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:00 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909" returned: 1 in 1.081s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Downloaded image 2ce391f0-9c46-48a6-b7b5-c03fa61880a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ce391f0-9c46-48a6-b7b5-c03fa61880a0', 'metadata': {}}])) to volume 0ff87c49-0cad-4213-ba34-c1107b2e1909 successfully. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Temporary image 2ce391f0-9c46-48a6-b7b5-c03fa61880a0 for user 8763cd655e26405795436b7c2d1585b5 is deleted. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Marking volume 0ff87c49-0cad-4213-ba34-c1107b2e1909 as bootable. {{(pid=93300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Copying metadata from image 2ce391f0-9c46-48a6-b7b5-c03fa61880a0 to 0ff87c49-0cad-4213-ba34-c1107b2e1909. {{(pid=93300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Creating volume glance metadata for volume 0ff87c49-0cad-4213-ba34-c1107b2e1909 backed by image 2ce391f0-9c46-48a6-b7b5-c03fa61880a0 with: {'image_id': '2ce391f0-9c46-48a6-b7b5-c03fa61880a0', 'image_name': 'tempest-scenario-img--1351746967', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b10d09-d376-4cb5-9d6a-455329adf60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff87c49-0cad-4213-ba34-c1107b2e1909', 'volume_size': 1, 'image_id': '2ce391f0-9c46-48a6-b7b5-c03fa61880a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ce391f0-9c46-48a6-b7b5-c03fa61880a0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1351746967', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9fbe97571f984bf6b1d7b812d6d23863', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2ce391f0-9c46-48a6-b7b5-c03fa61880a0', 'created_at': datetime.datetime(2026, 6, 19, 2, 23, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 23, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ce391f0-9c46-48a6-b7b5-c03fa61880a0/file', 'properties': {}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad493d3-7c2b-452a-8ade-4e9fbb7aa722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:00 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Volume volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 (0ff87c49-0cad-4213-ba34-c1107b2e1909): created successfully Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad493d3-7c2b-452a-8ade-4e9fbb7aa722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Flow 'volume_create_manager' (939650ef-df0b-4ab8-88d6-69316bf2e0c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:00 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-61ce4949-11c3-4dae-9526-b4c0f6d593d8 tempest-TestInstancesWithCinderVolumes-921932341 None] Created volume successfully. Jun 19 04:24:00 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d" returned: 0 in 0.935s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b66d7d13-ee26-419f-879d-6f8680ede565(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:00 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 1G Jun 19 04:24:00 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Flow 'volume_create_manager' (88cc6ad8-9919-4952-b130-524823bc5d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9309eb08-3db8-4321-abba-152edd22f7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9309eb08-3db8-4321-abba-152edd22f7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2113770839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415946bb-bc00-4d5c-b34a-cd0876ce7882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700a4bde2e3c45dda02a83e7f4b0a3f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:01Z,use_quota=True,user_id='ea63230d391f4371b9c634d55822b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ea0c67-ba71-49b0-89c4-2feb97d07240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ea0c67-ba71-49b0-89c4-2feb97d07240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca709966-d2f9-4b77-83d1-62cdb9ce0bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca709966-d2f9-4b77-83d1-62cdb9ce0bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '415946bb-bc00-4d5c-b34a-cd0876ce7882', 'volume_name': 'volume-415946bb-bc00-4d5c-b34a-cd0876ce7882', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f6ef64-b614-450e-bc79-daf44de46b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f6ef64-b614-450e-bc79-daf44de46b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d11baa-04ef-495d-b41e-bdccc0285d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:01 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Volume 415946bb-bc00-4d5c-b34a-cd0876ce7882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-415946bb-bc00-4d5c-b34a-cd0876ce7882', 'volume_size': 1} Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:01 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 1G" returned: 0 in 0.957s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:01 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 Jun 19 04:24:01 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:02 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715" returned: 0 in 0.842s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:02 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 is being set with open permissions: ugo+rw Jun 19 04:24:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:02 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 Jun 19 04:24:02 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:02 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Flow 'volume_create_manager' (007c2309-de90-47cd-94a3-0a1508806d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96596cfb-5407-463c-bfeb-3c0ef47bbcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96596cfb-5407-463c-bfeb-3c0ef47bbcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1553252814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771db846-9e8f-4a4b-adfa-eb27272e2bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc21cb4ff0f462ba7b0772428452845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:03Z,use_quota=True,user_id='a496e5fb6bc147beb865e3dd3aa00fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b89e3e1-cb08-413b-8c01-83167b132a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b89e3e1-cb08-413b-8c01-83167b132a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b80c52-95a0-4e4d-a7e5-9d9b3bc4519d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:02 devstack cinder-volume[93300]: DEBUG cinder.image.glance [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Creating Keystone auth plugin from conf {{(pid=93300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b80c52-95a0-4e4d-a7e5-9d9b3bc4519d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '771db846-9e8f-4a4b-adfa-eb27272e2bc1', 'volume_name': 'volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1', 'volume_size': 1, 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dffb3ac9be154db7807c947881bed470', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'created_at': datetime.datetime(2026, 6, 19, 2, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0092ebe-9dc8-4ecb-a729-e4ab08ca70d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0092ebe-9dc8-4ecb-a729-e4ab08ca70d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75287e26-60e0-4b05-aedd-69e684b5acb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:03 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Volume 771db846-9e8f-4a4b-adfa-eb27272e2bc1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1', 'volume_size': 1, 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dffb3ac9be154db7807c947881bed470', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'created_at': datetime.datetime(2026, 6, 19, 2, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Trying to clone 771db846-9e8f-4a4b-adfa-eb27272e2bc1 from image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 at location (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]). {{(pid=93300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:24:03 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715" returned: 0 in 0.762s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.652s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.296s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2113770839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415946bb-bc00-4d5c-b34a-cd0876ce7882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700a4bde2e3c45dda02a83e7f4b0a3f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:01Z,use_quota=True,user_id='ea63230d391f4371b9c634d55822b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Creating volume 415946bb-bc00-4d5c-b34a-cd0876ce7882 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:03 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-415946bb-bc00-4d5c-b34a-cd0876ce7882 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:03 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-415946bb-bc00-4d5c-b34a-cd0876ce7882 1073741824 Jun 19 04:24:03 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:03 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-56c24d6d-af7e-4661-9d19-a3823fd13bbb tempest-VolumesDeleteCascade-1286972204 None] Create snapshot completed successfully Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:24:03 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Image download 20.69 MB at 20.69 MB/s Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3be571-4667-4082-aea9-fc398427f006]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:03 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD Jun 19 04:24:03 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-b66d7d13-ee26-419f-879d-6f8680ede565-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-b66d7d13-ee26-419f-879d-6f8680ede565-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:04 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-415946bb-bc00-4d5c-b34a-cd0876ce7882 1073741824" returned: 0 in 0.969s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Performing cascade delete. {{(pid=93300) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-415946bb-bc00-4d5c-b34a-cd0876ce7882 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:04 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-8ee71037-30e9-425d-bd81-ef01e1326f8d-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD" returned: 0 in 0.848s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Temporary image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 is fetched for user a496e5fb6bc147beb865e3dd3aa00fa3. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:24:04 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-415946bb-bc00-4d5c-b34a-cd0876ce7882 Jun 19 04:24:04 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-8ee71037-30e9-425d-bd81-ef01e1326f8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-quobyte-b66d7d13-ee26-419f-879d-6f8680ede565" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-b66d7d13-ee26-419f-879d-6f8680ede565" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-quobyte-8ee71037-30e9-425d-bd81-ef01e1326f8d" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-8ee71037-30e9-425d-bd81-ef01e1326f8d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Deleting offline snapshot 8ee71037-30e9-425d-bd81-ef01e1326f8d of volume b66d7d13-ee26-419f-879d-6f8680ede565 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] snapshot_file for this snap is: volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a54963b-91f2-4985-80ed-fa2662e155ff]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[713e074f-af6d-42df-86fc-7f0d5c2f03ac]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:04 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d Jun 19 04:24:04 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:04 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD Jun 19 04:24:04 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:05 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-415946bb-bc00-4d5c-b34a-cd0876ce7882" returned: 0 in 0.703s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d11baa-04ef-495d-b41e-bdccc0285d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-415946bb-bc00-4d5c-b34a-cd0876ce7882', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f7336f-f189-41d6-87f5-d437869163e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:05 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Volume volume-415946bb-bc00-4d5c-b34a-cd0876ce7882 (415946bb-bc00-4d5c-b34a-cd0876ce7882): created successfully Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f7336f-f189-41d6-87f5-d437869163e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Flow 'volume_create_manager' (88cc6ad8-9919-4952-b130-524823bc5d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:05 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b6332b46-e11b-4c19-8b0e-64164def6c28 tempest-VolumesListAdminTestJSON-473824112 None] Created volume successfully. Jun 19 04:24:05 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1553252814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771db846-9e8f-4a4b-adfa-eb27272e2bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc21cb4ff0f462ba7b0772428452845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:03Z,use_quota=True,user_id='a496e5fb6bc147beb865e3dd3aa00fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Creating volume 771db846-9e8f-4a4b-adfa-eb27272e2bc1 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:05 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:05 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d" returned: 0 in 0.832s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b66d7d13-ee26-419f-879d-6f8680ede565(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:05 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 1073741824 Jun 19 04:24:05 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4713badb-7100-48e8-ae53-0bd4bbb30aa3]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:05 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 Jun 19 04:24:05 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:06 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565" returned: 0 in 0.802s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:06 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 1073741824" returned: 0 in 0.896s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:06 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3f357b-93de-4a6d-aff6-4dbc7717206e]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:06 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 Jun 19 04:24:06 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:06 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 Jun 19 04:24:06 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:07 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1" returned: 0 in 0.724s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Attempting download of 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 ((None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}])) to volume 771db846-9e8f-4a4b-adfa-eb27272e2bc1. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:24:07 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715" returned: 0 in 0.825s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b66d7d13-ee26-419f-879d-6f8680ede565(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56f33e8-5e7c-428f-98f2-18ce04acbed9]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Flow 'volume_create_manager' (be7af752-ef01-492d-95a7-85e80f8a2941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd87898f-450e-489a-bedc-26ab5ab7c7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd87898f-450e-489a-bedc-26ab5ab7c7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d72441c-2364-4aad-8322-1cf36c393190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a021dcfeae26465a922ac0a85154de11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:07Z,use_quota=True,user_id='b0bd2d024cba4ad28a1bf98f144be78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b8f531-131a-4dc2-b240-fb6589d71768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b8f531-131a-4dc2-b240-fb6589d71768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3dd72c-9111-4911-aee8-ff8eb4fc6e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3dd72c-9111-4911-aee8-ff8eb4fc6e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d72441c-2364-4aad-8322-1cf36c393190', 'volume_name': 'volume-6d72441c-2364-4aad-8322-1cf36c393190', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37333f29-0b29-405b-932f-f8bcdcb857b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37333f29-0b29-405b-932f-f8bcdcb857b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e03d7a-5df2-4550-a231-90b5c4298a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:07 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Volume 6d72441c-2364-4aad-8322-1cf36c393190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d72441c-2364-4aad-8322-1cf36c393190', 'volume_size': 1} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d72441c-2364-4aad-8322-1cf36c393190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a021dcfeae26465a922ac0a85154de11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:07Z,use_quota=True,user_id='b0bd2d024cba4ad28a1bf98f144be78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Creating volume 6d72441c-2364-4aad-8322-1cf36c393190 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:07 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6d72441c-2364-4aad-8322-1cf36c393190 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:07 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d Jun 19 04:24:07 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1445dd-ed24-4f30-95d3-f034ee409a1a]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_orw40z7f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:07 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6d72441c-2364-4aad-8322-1cf36c393190 1073741824 Jun 19 04:24:07 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:07 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_orw40z7f Jun 19 04:24:07 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:08 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d" returned: 0 in 0.815s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b66d7d13-ee26-419f-879d-6f8680ede565(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8192e8ab-22d7-486a-a6d0-b864f9e6ede2]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:08 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_orw40z7f" returned: 0 in 0.788s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_orw40z7f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:08 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 Jun 19 04:24:08 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:08 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6d72441c-2364-4aad-8322-1cf36c393190 1073741824" returned: 0 in 0.849s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6d72441c-2364-4aad-8322-1cf36c393190 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:08 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6d72441c-2364-4aad-8322-1cf36c393190 Jun 19 04:24:08 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:08 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_orw40z7f Jun 19 04:24:08 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:08 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565" returned: 0 in 0.849s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:08 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6d72441c-2364-4aad-8322-1cf36c393190" returned: 0 in 0.686s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:08 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d Jun 19 04:24:08 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e03d7a-5df2-4550-a231-90b5c4298a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d72441c-2364-4aad-8322-1cf36c393190', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:08 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b597a2-9a5d-4e8c-80f6-944e4470dd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:08 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Volume volume-6d72441c-2364-4aad-8322-1cf36c393190 (6d72441c-2364-4aad-8322-1cf36c393190): created successfully Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b597a2-9a5d-4e8c-80f6-944e4470dd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Flow 'volume_create_manager' (be7af752-ef01-492d-95a7-85e80f8a2941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:09 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_orw40z7f" returned: 1 in 0.837s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_orw40z7f' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c1983d-1c49-4ab2-a76c-203a7488cd1c]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:09 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-89750960-7b18-4272-882f-293e4a0f1c9f tempest-VolumesListAdminTestJSON-1022236144 None] Created volume successfully. Jun 19 04:24:09 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD Jun 19 04:24:09 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Acquiring lock "cinder-6d72441c-2364-4aad-8322-1cf36c393190-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Lock "cinder-6d72441c-2364-4aad-8322-1cf36c393190-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Acquiring lock "cinder-quobyte-6d72441c-2364-4aad-8322-1cf36c393190" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Lock "cinder-quobyte-6d72441c-2364-4aad-8322-1cf36c393190" acquired by "delete_volume" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41af150-72dd-4c35-893c-6ede75093db6]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6d72441c-2364-4aad-8322-1cf36c393190 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "cinder-415946bb-bc00-4d5c-b34a-cd0876ce7882-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Lock "cinder-415946bb-bc00-4d5c-b34a-cd0876ce7882-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:09 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6d72441c-2364-4aad-8322-1cf36c393190 Jun 19 04:24:09 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "cinder-quobyte-415946bb-bc00-4d5c-b34a-cd0876ce7882" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Lock "cinder-quobyte-415946bb-bc00-4d5c-b34a-cd0876ce7882" acquired by "delete_volume" :: waited 0.065s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:10 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d" returned: 0 in 1.211s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:10 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf8db3e-6b32-4272-ab69-47c5ad3e677a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-415946bb-bc00-4d5c-b34a-cd0876ce7882 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:10 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d Jun 19 04:24:10 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:10 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD" returned: 0 in 1.287s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:10 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 was qcow2, converting to raw {{(pid=93300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:24:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:10 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-415946bb-bc00-4d5c-b34a-cd0876ce7882 Jun 19 04:24:10 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:10 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 Jun 19 04:24:10 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-3fec4b4c-e0bb-4def-8eb8-e568bf3662a4 req-5ae5fd7c-5082-473c-a6e2-93e315052038 tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-3fec4b4c-e0bb-4def-8eb8-e568bf3662a4 req-5ae5fd7c-5082-473c-a6e2-93e315052038 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:10 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40e4191-b700-4c85-acac-f7bbf72794a8]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-3fec4b4c-e0bb-4def-8eb8-e568bf3662a4 req-5ae5fd7c-5082-473c-a6e2-93e315052038 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:11 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 Jun 19 04:24:11 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:11 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6d72441c-2364-4aad-8322-1cf36c393190" returned: 0 in 1.573s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6d72441c-2364-4aad-8322-1cf36c393190 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:11 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6d72441c-2364-4aad-8322-1cf36c393190 Jun 19 04:24:11 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:11 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.8ee71037-30e9-425d-bd81-ef01e1326f8d" returned: 0 in 1.234s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66d7d13-ee26-419f-879d-6f8680ede565 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 -F qcow2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:11 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66d7d13-ee26-419f-879d-6f8680ede565 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 -F qcow2 Jun 19 04:24:11 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:11 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-415946bb-bc00-4d5c-b34a-cd0876ce7882" returned: 0 in 1.508s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-415946bb-bc00-4d5c-b34a-cd0876ce7882 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:11 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-415946bb-bc00-4d5c-b34a-cd0876ce7882 Jun 19 04:24:11 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:12 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6d72441c-2364-4aad-8322-1cf36c393190" returned: 0 in 1.165s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Lock "cinder-quobyte-6d72441c-2364-4aad-8322-1cf36c393190" released by "delete_volume" :: held 2.808s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:12 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66d7d13-ee26-419f-879d-6f8680ede565 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 -F qcow2" returned: 0 in 1.110s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:12 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-3fec4b4c-e0bb-4def-8eb8-e568bf3662a4 req-5ae5fd7c-5082-473c-a6e2-93e315052038 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909" returned: 0 in 1.610s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-8ee71037-30e9-425d-bd81-ef01e1326f8d" released by "_delete_snapshot" :: held 7.880s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-3fec4b4c-e0bb-4def-8eb8-e568bf3662a4 req-5ae5fd7c-5082-473c-a6e2-93e315052038 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-b66d7d13-ee26-419f-879d-6f8680ede565" released by "delete_snapshot" :: held 7.919s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Created reservations ['c72cedf6-ad7a-4d96-aea6-72e71475cb67', 'a9977b5b-1c1c-4cc6-886b-bad8ff8ffeba', '3739c7d1-82f9-4a53-8f85-81b6ee6e2c24', 'f5c73575-17ef-4743-8775-fa6d4e0c3164'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:12 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 Jun 19 04:24:12 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:12 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-415946bb-bc00-4d5c-b34a-cd0876ce7882" returned: 0 in 1.032s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Lock "cinder-quobyte-415946bb-bc00-4d5c-b34a-cd0876ce7882" released by "delete_volume" :: held 2.648s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Created reservations ['27af0201-f033-4679-bddc-6f3c7cf07860', 'ff277a4f-fb82-4a02-b60b-31c7aae78493', 'ee99e79b-9565-4e1d-b85f-e778bd5c1487', '9768988f-c843-445f-b72c-a138b005c8a4'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:12 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:24:12 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:12 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Delete snapshot completed successfully. Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Created reservations ['f676e554-2e05-4bd2-a8b9-76e43ac0a26a', '1b5e2a65-4a92-46d6-91a4-62eb586ebaf5', '136b8c49-9e29-4519-9874-46eb35e1213f', 'd2dde01f-e60b-492e-a8fd-5e05146e2093'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-8ee71037-30e9-425d-bd81-ef01e1326f8d-delete_snapshot" released by "delete_snapshot" :: held 8.428s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-f5fd07d9-d13d-4914-95c0-23068077e715-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-f5fd07d9-d13d-4914-95c0-23068077e715-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-quobyte-b66d7d13-ee26-419f-879d-6f8680ede565" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-b66d7d13-ee26-419f-879d-6f8680ede565" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-quobyte-f5fd07d9-d13d-4914-95c0-23068077e715" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-f5fd07d9-d13d-4914-95c0-23068077e715" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Deleting offline snapshot f5fd07d9-d13d-4914-95c0-23068077e715 of volume b66d7d13-ee26-419f-879d-6f8680ede565 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] snapshot_file for this snap is: volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[556c5b55-926e-4b7b-83ec-4017b8465d41]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:13 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:24:13 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:13 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1" returned: 0 in 3.033s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_ryglc70adevstack@QuobyteHD, size 112.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:24:13 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Converted 112.00 MB image at 36.91 MB/s Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:13 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 Jun 19 04:24:13 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:13 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 1G Jun 19 04:24:13 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "cinder-505f3304-44c3-435f-b314-e902374fd17a-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Lock "cinder-505f3304-44c3-435f-b314-e902374fd17a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "cinder-quobyte-505f3304-44c3-435f-b314-e902374fd17a" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:13 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-3fec4b4c-e0bb-4def-8eb8-e568bf3662a4 req-5ae5fd7c-5082-473c-a6e2-93e315052038 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909" returned: 1 in 1.280s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-3fec4b4c-e0bb-4def-8eb8-e568bf3662a4 req-5ae5fd7c-5082-473c-a6e2-93e315052038 tempest-TestInstancesWithCinderVolumes-921932341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-3fec4b4c-e0bb-4def-8eb8-e568bf3662a4 req-5ae5fd7c-5082-473c-a6e2-93e315052038 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.973s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Lock "cinder-quobyte-505f3304-44c3-435f-b314-e902374fd17a" acquired by "delete_volume" :: waited 0.047s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f425a60d-93e7-4c55-b306-d498028dd283]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-505f3304-44c3-435f-b314-e902374fd17a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-3fec4b4c-e0bb-4def-8eb8-e568bf3662a4 req-5ae5fd7c-5082-473c-a6e2-93e315052038 tempest-TestInstancesWithCinderVolumes-921932341 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-0ff87c49-0cad-4213-ba34-c1107b2e1909', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '386abe36-b398-460e-abb5-401da9c30231', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:24:14 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:14 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-3fec4b4c-e0bb-4def-8eb8-e568bf3662a4 req-5ae5fd7c-5082-473c-a6e2-93e315052038 tempest-TestInstancesWithCinderVolumes-921932341 None] attachment_update completed successfully. Jun 19 04:24:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.193s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:14 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:14 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-505f3304-44c3-435f-b314-e902374fd17a Jun 19 04:24:14 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:14 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Deleted volume successfully. Jun 19 04:24:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dee6b615-c031-4414-80f2-130919ec1257 tempest-VolumesListAdminTestJSON-1022236144 None] Lock "cinder-6d72441c-2364-4aad-8322-1cf36c393190-delete_volume" released by "delete_volume" :: held 4.629s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:14 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.210s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:14 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:14 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Deleted volume successfully. Jun 19 04:24:14 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-46fdd69d-c226-4133-9830-b2503a01d381 tempest-VolumesListAdminTestJSON-473824112 None] Lock "cinder-415946bb-bc00-4d5c-b34a-cd0876ce7882-delete_volume" released by "delete_volume" :: held 4.539s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715" returned: 0 in 1.232s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b66d7d13-ee26-419f-879d-6f8680ede565(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:14 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[677d0f1f-028e-42ac-b3cc-b7a9097b1354]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:14 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 1G" returned: 0 in 1.186s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:14 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61821b7-c50e-41ab-925a-2bf74f8402a9]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:14 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 Jun 19 04:24:14 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:14 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 Jun 19 04:24:14 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:15 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-505f3304-44c3-435f-b314-e902374fd17a" returned: 0 in 1.152s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-505f3304-44c3-435f-b314-e902374fd17a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:15 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-505f3304-44c3-435f-b314-e902374fd17a Jun 19 04:24:15 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:15 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565" returned: 0 in 0.844s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:15 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 Jun 19 04:24:15 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:15 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1" returned: 0 in 0.808s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:15 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 Jun 19 04:24:15 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:15 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-505f3304-44c3-435f-b314-e902374fd17a" returned: 0 in 0.764s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Lock "cinder-quobyte-505f3304-44c3-435f-b314-e902374fd17a" released by "delete_volume" :: held 1.991s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Created reservations ['6272cd93-84e6-42ad-9710-5a4c200b2207', '786cdd50-4f26-4702-9784-c6cf7aa721a7', '697dd081-de0f-4202-ab6d-8aaf7e134160', 'bd1e90e1-532e-4533-b065-f5669bf853df'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:16 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:24:16 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "cinder-35f82eee-6ef6-48af-b623-cfe96851cf78-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Lock "cinder-35f82eee-6ef6-48af-b623-cfe96851cf78-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:16 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715" returned: 0 in 0.935s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:16 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1" returned: 1 in 0.908s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Downloaded image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 ((None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}])) to volume 771db846-9e8f-4a4b-adfa-eb27272e2bc1 successfully. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Temporary image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 for user a496e5fb6bc147beb865e3dd3aa00fa3 is deleted. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Marking volume 771db846-9e8f-4a4b-adfa-eb27272e2bc1 as bootable. {{(pid=93300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "cinder-quobyte-35f82eee-6ef6-48af-b623-cfe96851cf78" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:16 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715 Jun 19 04:24:16 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Copying metadata from image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 to 771db846-9e8f-4a4b-adfa-eb27272e2bc1. {{(pid=93300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Creating volume glance metadata for volume 771db846-9e8f-4a4b-adfa-eb27272e2bc1 backed by image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Lock "cinder-quobyte-35f82eee-6ef6-48af-b623-cfe96851cf78" acquired by "delete_volume" :: waited 0.038s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[243229f4-2404-4f39-acea-46ec7c168660]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-35f82eee-6ef6-48af-b623-cfe96851cf78 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75287e26-60e0-4b05-aedd-69e684b5acb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1', 'volume_size': 1, 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dffb3ac9be154db7807c947881bed470', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'created_at': datetime.datetime(2026, 6, 19, 2, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cac68c3-cec8-42a2-b0e4-73703c4129ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:16 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Volume volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 (771db846-9e8f-4a4b-adfa-eb27272e2bc1): created successfully Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cac68c3-cec8-42a2-b0e4-73703c4129ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Flow 'volume_create_manager' (007c2309-de90-47cd-94a3-0a1508806d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c35dd32f-1d2c-453e-ae0f-a70f1413b3c2 tempest-VolumesExtendTest-77945022 None] Created volume successfully. Jun 19 04:24:16 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-35f82eee-6ef6-48af-b623-cfe96851cf78 Jun 19 04:24:16 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:16 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.831s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Deleted volume successfully. Jun 19 04:24:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cdd32e4b-88ef-413a-aa7c-124cfda87d5f tempest-VolumesListAdminTestJSON-473824112 None] Lock "cinder-505f3304-44c3-435f-b314-e902374fd17a-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:17 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565.f5fd07d9-d13d-4914-95c0-23068077e715" returned: 0 in 0.755s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-f5fd07d9-d13d-4914-95c0-23068077e715" released by "_delete_snapshot" :: held 3.952s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-b66d7d13-ee26-419f-879d-6f8680ede565" released by "delete_snapshot" :: held 3.983s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Created reservations ['6d33dee6-1b8a-420d-b47d-eebd5bc5a9c4', 'ca7a00f0-a70e-43c1-8bb7-2b199fc25554', '41cb73ae-90b3-4236-a3c1-42763bada1fd', '0a7ba23e-6452-4031-9e40-e71291d62fc3'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a4ca6ba-1e87-4ab8-a928-0bd3907f8cd4 tempest-VolumesExtendTest-77945022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a4ca6ba-1e87-4ab8-a928-0bd3907f8cd4 tempest-VolumesExtendTest-77945022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd52e75d-faa8-4064-9c08-c30dba8c7e38]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a4ca6ba-1e87-4ab8-a928-0bd3907f8cd4 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:17 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Delete snapshot completed successfully. Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-f5fd07d9-d13d-4914-95c0-23068077e715-delete_snapshot" released by "delete_snapshot" :: held 4.216s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Snapshots deleted, issuing volume delete {{(pid=93300) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-quobyte-b66d7d13-ee26-419f-879d-6f8680ede565" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-b66d7d13-ee26-419f-879d-6f8680ede565" acquired by "delete_volume" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[81011395-0cc9-47db-8f33-76ea3b6b6982]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:17 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 Jun 19 04:24:17 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:17 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 Jun 19 04:24:17 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:17 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-35f82eee-6ef6-48af-b623-cfe96851cf78" returned: 0 in 1.073s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-35f82eee-6ef6-48af-b623-cfe96851cf78 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:17 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-35f82eee-6ef6-48af-b623-cfe96851cf78 Jun 19 04:24:17 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:18 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565" returned: 0 in 0.811s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:18 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-35f82eee-6ef6-48af-b623-cfe96851cf78" returned: 0 in 0.662s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:18 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565 Jun 19 04:24:18 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:18 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a4ca6ba-1e87-4ab8-a928-0bd3907f8cd4 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1" returned: 0 in 0.943s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a4ca6ba-1e87-4ab8-a928-0bd3907f8cd4 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Lock "cinder-quobyte-35f82eee-6ef6-48af-b623-cfe96851cf78" released by "delete_volume" :: held 1.826s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Created reservations ['25e3f755-993f-4e4e-a061-d2d889de6305', '1e579b3c-b329-472a-a97f-2e92fd20dfc2', '502e2b29-c4cb-4524-9a7e-97477e650e4f', 'b31fbed0-2324-45ef-b8ae-b71c5e4c61fb'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:18 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 Jun 19 04:24:18 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:18 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:24:18 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:18 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b66d7d13-ee26-419f-879d-6f8680ede565" returned: 0 in 0.810s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-b66d7d13-ee26-419f-879d-6f8680ede565" released by "delete_volume" :: held 1.684s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Created reservations ['0da6d59c-1d33-4a67-9f20-78acce192913', 'b77934d3-feae-4cd8-a7fc-2eea6b797fdc', 'd1ddfa61-61ee-416e-8561-31236005b584', 'f0f1b691-c3e3-47a7-8296-5d88872ad7b1'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:19 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a4ca6ba-1e87-4ab8-a928-0bd3907f8cd4 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1" returned: 1 in 0.967s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a4ca6ba-1e87-4ab8-a928-0bd3907f8cd4 tempest-VolumesExtendTest-77945022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a4ca6ba-1e87-4ab8-a928-0bd3907f8cd4 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 2G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:19 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:19 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:24:19 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.877s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a4ca6ba-1e87-4ab8-a928-0bd3907f8cd4 tempest-VolumesExtendTest-77945022 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 2G" returned: 0 in 0.103s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a4ca6ba-1e87-4ab8-a928-0bd3907f8cd4 tempest-VolumesExtendTest-77945022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.082s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:19 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Deleted volume successfully. Jun 19 04:24:19 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:24:19 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ace393b4-bf14-46b9-b280-f37eb6d953ef tempest-VolumesListAdminTestJSON-473824112 None] Lock "cinder-35f82eee-6ef6-48af-b623-cfe96851cf78-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:19 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3a4ca6ba-1e87-4ab8-a928-0bd3907f8cd4 tempest-VolumesExtendTest-77945022 None] Extend volume completed successfully. Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Acquiring lock "cinder-771db846-9e8f-4a4b-adfa-eb27272e2bc1-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:19 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Lock "cinder-771db846-9e8f-4a4b-adfa-eb27272e2bc1-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Acquiring lock "cinder-quobyte-771db846-9e8f-4a4b-adfa-eb27272e2bc1" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Lock "cinder-quobyte-771db846-9e8f-4a4b-adfa-eb27272e2bc1" acquired by "delete_volume" :: waited 0.045s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:20 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5a2843-434f-41ea-8932-7e501d95d407]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:20 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 Jun 19 04:24:20 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:20 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.334s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:20 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.378s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:20 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Deleted volume successfully. Jun 19 04:24:20 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:24:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 29 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:24:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:24:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2786aad-bdb5-4781-8c71-c66ebc770047 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-b66d7d13-ee26-419f-879d-6f8680ede565-delete_volume" released by "delete_volume" :: held 16.143s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Flow 'volume_create_manager' (8c110ae1-91cf-491a-9dbc-545878e673c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a386b7f-12d9-49b6-88d1-9154ff799879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a386b7f-12d9-49b6-88d1-9154ff799879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1026350038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be99f911-a492-4393-9e42-ab9d08091051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0063fa1328fb444aa54f57d2a6d3ed61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:21Z,use_quota=True,user_id='945dec50ddf747dd8c1972a026fbb551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ca16a1-377f-46e5-95f8-06c9032cd55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ca16a1-377f-46e5-95f8-06c9032cd55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26549085-1a90-4bc8-a1b4-5abf971d940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26549085-1a90-4bc8-a1b4-5abf971d940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be99f911-a492-4393-9e42-ab9d08091051', 'volume_name': 'volume-be99f911-a492-4393-9e42-ab9d08091051', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe20b0e0-837d-4bfc-b02e-23a016189cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe20b0e0-837d-4bfc-b02e-23a016189cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1a24fa-6236-4c4f-94aa-93ea5fec1d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:21 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Volume be99f911-a492-4393-9e42-ab9d08091051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be99f911-a492-4393-9e42-ab9d08091051', 'volume_size': 1} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1026350038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be99f911-a492-4393-9e42-ab9d08091051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0063fa1328fb444aa54f57d2a6d3ed61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:21Z,use_quota=True,user_id='945dec50ddf747dd8c1972a026fbb551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Creating volume be99f911-a492-4393-9e42-ab9d08091051 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:21 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:21 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1" returned: 0 in 1.572s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:21 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 1073741824 Jun 19 04:24:21 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:21 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 Jun 19 04:24:21 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:22 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 1073741824" returned: 0 in 1.175s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:22 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 Jun 19 04:24:22 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:23 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1" returned: 1 in 1.288s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:24:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:23 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1 Jun 19 04:24:23 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:24 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051" returned: 0 in 1.153s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] <== create_volume: return (2385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.389s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:24 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-771db846-9e8f-4a4b-adfa-eb27272e2bc1" returned: 0 in 1.044s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1a24fa-6236-4c4f-94aa-93ea5fec1d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be99f911-a492-4393-9e42-ab9d08091051', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbae5123-8e16-4f43-ace7-306a5bdf2f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Lock "cinder-quobyte-771db846-9e8f-4a4b-adfa-eb27272e2bc1" released by "delete_volume" :: held 4.058s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:24 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Volume volume-be99f911-a492-4393-9e42-ab9d08091051 (be99f911-a492-4393-9e42-ab9d08091051): created successfully Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbae5123-8e16-4f43-ace7-306a5bdf2f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Flow 'volume_create_manager' (8c110ae1-91cf-491a-9dbc-545878e673c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:24 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c4970465-3efb-4b68-8207-e6f516aea509 tempest-VolumesDeleteCascade-1286972204 None] Created volume successfully. Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Created reservations ['6de95181-a0a8-48fd-bf0f-c3c9888a7f52', 'c6fba538-d35a-4aaa-b808-3d12fd058fda', '4c5476d2-a861-4c58-a375-27b4697aa91f', '8d83284f-784f-4db9-b5a6-5d6618acfc2e'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:24 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:24:24 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:25 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.192s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:25 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Deleted volume successfully. Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9309e447-8ee4-411d-8b40-0246131e9d84 tempest-VolumesExtendTest-77945022 None] Lock "cinder-771db846-9e8f-4a4b-adfa-eb27272e2bc1-delete_volume" released by "delete_volume" :: held 5.597s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Flow 'volume_create_manager' (f2ea992f-f29c-4f8a-a662-6709e4743397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8290badc-0b2b-4f84-b1db-a8ca3ad0c701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8290badc-0b2b-4f84-b1db-a8ca3ad0c701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-903938163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc9d90a-3d4f-4372-9453-5796d4c36f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc21cb4ff0f462ba7b0772428452845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:25Z,use_quota=True,user_id='a496e5fb6bc147beb865e3dd3aa00fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ea19ff-01b9-44c1-8107-dff2a7c20f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ea19ff-01b9-44c1-8107-dff2a7c20f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb05b40f-bd28-4a0a-b9f8-5c85bf0d6b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb05b40f-bd28-4a0a-b9f8-5c85bf0d6b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcc9d90a-3d4f-4372-9453-5796d4c36f4a', 'volume_name': 'volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5e0cd3-eddc-40d3-a0d2-8679d95bdc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5e0cd3-eddc-40d3-a0d2-8679d95bdc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9a103d-ca76-4c02-9c2d-008769f87c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:25 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Volume dcc9d90a-3d4f-4372-9453-5796d4c36f4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a', 'volume_size': 1} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] Creating offline snapshot 39f38e21-f011-4a70-a023-73d472b2a6f6 of volume be99f911-a492-4393-9e42-ab9d08091051 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38d69eb-0ea4-43ad-826a-c1c5d6f45363]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:25 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 Jun 19 04:24:25 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:26 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051" returned: 0 in 1.167s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:26 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 1G Jun 19 04:24:26 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:28 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 1G" returned: 0 in 1.396s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be99f911-a492-4393-9e42-ab9d08091051 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:28 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be99f911-a492-4393-9e42-ab9d08091051 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 Jun 19 04:24:28 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:29 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be99f911-a492-4393-9e42-ab9d08091051 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6" returned: 0 in 0.982s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:29 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 is being set with open permissions: ugo+rw Jun 19 04:24:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:29 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 Jun 19 04:24:29 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:30 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:30 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=87,cinder:UPDATE=107,cinder:INSERT=32,cinder:DELETE=9 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:24:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6" returned: 0 in 1.363s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:30 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=108,cinder:SELECT=103,cinder:INSERT=37,cinder:DELETE=10 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:24:30 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Flow 'volume_create_manager' (8d205394-a4c6-4cf2-8231-86149a06cf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc83bb8d-b667-4243-9e7a-f804af82e116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc83bb8d-b667-4243-9e7a-f804af82e116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1578398299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7672bb5-1e1d-459d-b64d-104e0af7b158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f89948a86dc244ea86bc13b76aae2bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:31Z,use_quota=True,user_id='f135c8547a674d8bac05e277d2fc9442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e265d66-acf2-479f-a7cb-31f8c08d45dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e265d66-acf2-479f-a7cb-31f8c08d45dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5618bfd7-3019-42f3-8b65-4a9b1686f19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:30 devstack cinder-volume[93300]: DEBUG cinder.image.glance [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Creating Keystone auth plugin from conf {{(pid=93300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:24:30 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.info Jun 19 04:24:30 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5618bfd7-3019-42f3-8b65-4a9b1686f19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7672bb5-1e1d-459d-b64d-104e0af7b158', 'volume_name': 'volume-b7672bb5-1e1d-459d-b64d-104e0af7b158', 'volume_size': 1, 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dffb3ac9be154db7807c947881bed470', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'created_at': datetime.datetime(2026, 6, 19, 2, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0988de04-1d51-4d1d-b711-1804944a4be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0988de04-1d51-4d1d-b711-1804944a4be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:31 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbf8626-a2ae-48da-9f62-561fb115e0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:31 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Volume b7672bb5-1e1d-459d-b64d-104e0af7b158: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7672bb5-1e1d-459d-b64d-104e0af7b158', 'volume_size': 1, 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dffb3ac9be154db7807c947881bed470', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'created_at': datetime.datetime(2026, 6, 19, 2, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 19 04:24:31 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Trying to clone b7672bb5-1e1d-459d-b64d-104e0af7b158 from image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 at location (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]). {{(pid=93300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:24:31 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:24:31 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Image download 20.69 MB at 20.69 MB/s Jun 19 04:24:31 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c15c42-4db0-4555-a7d4-a6993cc963b8]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:31 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.info" returned: 0 in 1.225s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:31 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.info is being set with open permissions: ugo+rw Jun 19 04:24:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:31 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.info Jun 19 04:24:31 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:32 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD Jun 19 04:24:32 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:32 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.info" returned: 0 in 0.918s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.339s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.212s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-903938163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc9d90a-3d4f-4372-9453-5796d4c36f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc21cb4ff0f462ba7b0772428452845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:25Z,use_quota=True,user_id='a496e5fb6bc147beb865e3dd3aa00fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Creating volume dcc9d90a-3d4f-4372-9453-5796d4c36f4a {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:32 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:32 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD" returned: 0 in 1.094s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:32 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Temporary image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 is fetched for user f135c8547a674d8bac05e277d2fc9442. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:24:32 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a 1073741824 Jun 19 04:24:32 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:33 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f601d865-a588-474e-a325-098dc86ced24 tempest-VolumesDeleteCascade-1286972204 None] Create snapshot completed successfully Jun 19 04:24:33 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d172356-5b43-4870-96dc-bbbfcb973364]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:33 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD Jun 19 04:24:33 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:34 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD" returned: 0 in 0.936s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:34 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a 1073741824" returned: 0 in 1.280s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:34 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a Jun 19 04:24:34 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Flow 'volume_create_manager' (765ebbf8-ed5c-4683-8245-e315238f2420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8a951f-60ec-4050-9ce5-d4158f66e457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8a951f-60ec-4050-9ce5-d4158f66e457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-856477866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b93f90a-036f-4141-bd6a-2e79c3d0e764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0063fa1328fb444aa54f57d2a6d3ed61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=39f38e21-f011-4a70-a023-73d472b2a6f6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:35Z,use_quota=True,user_id='945dec50ddf747dd8c1972a026fbb551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e731d72-6b65-4515-85c8-95e19cad8fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e731d72-6b65-4515-85c8-95e19cad8fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ced86f-bac1-4de2-9980-b60a2d3b36ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ced86f-bac1-4de2-9980-b60a2d3b36ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8b93f90a-036f-4141-bd6a-2e79c3d0e764', 'volume_name': 'volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764', 'volume_size': 1, 'snapshot_id': '39f38e21-f011-4a70-a023-73d472b2a6f6'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8089c677-3468-4973-a22d-767a33f67812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8089c677-3468-4973-a22d-767a33f67812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abade0ac-d189-4678-95e3-2fd47be67822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:34 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Volume 8b93f90a-036f-4141-bd6a-2e79c3d0e764: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764', 'volume_size': 1, 'snapshot_id': '39f38e21-f011-4a70-a023-73d472b2a6f6'} Jun 19 04:24:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:35 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a" returned: 0 in 0.853s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.036s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1578398299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7672bb5-1e1d-459d-b64d-104e0af7b158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f89948a86dc244ea86bc13b76aae2bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:31Z,use_quota=True,user_id='f135c8547a674d8bac05e277d2fc9442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Creating volume b7672bb5-1e1d-459d-b64d-104e0af7b158 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:35 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:35 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 1073741824 Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9a103d-ca76-4c02-9c2d-008769f87c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:35 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48695a63-b9eb-4d46-8192-254ccf05b1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:35 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Volume volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a (dcc9d90a-3d4f-4372-9453-5796d4c36f4a): created successfully Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48695a63-b9eb-4d46-8192-254ccf05b1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Flow 'volume_create_manager' (f2ea992f-f29c-4f8a-a662-6709e4743397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:35 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ad23bd7c-e49b-4123-91fa-2e4786fe1666 tempest-VolumesExtendTest-77945022 None] Created volume successfully. Jun 19 04:24:35 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 1073741824" returned: 0 in 0.921s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:36 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 Jun 19 04:24:36 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:36 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158" returned: 0 in 0.722s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.993s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-quobyte-39f38e21-f011-4a70-a023-73d472b2a6f6-8b93f90a-036f-4141-bd6a-2e79c3d0e764" by "_create_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-39f38e21-f011-4a70-a023-73d472b2a6f6-8b93f90a-036f-4141-bd6a-2e79c3d0e764" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Creating volume 8b93f90a-036f-4141-bd6a-2e79c3d0e764 from snapshot 39f38e21-f011-4a70-a023-73d472b2a6f6 {{(pid=93300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-quobyte-8b93f90a-036f-4141-bd6a-2e79c3d0e764" by "_copy_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Attempting download of 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 ((None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}])) to volume b7672bb5-1e1d-459d-b64d-104e0af7b158. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-8b93f90a-036f-4141-bd6a-2e79c3d0e764" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] snapshot: 39f38e21-f011-4a70-a023-73d472b2a6f6, volume: 8b93f90a-036f-4141-bd6a-2e79c3d0e764, {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a4f6a2-2135-4492-bd28-332cf68b8ce0]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25da2d8-4903-4902-a7a6-56db0f334ebb]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_jj4pylfv {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:36 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 Jun 19 04:24:36 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:37 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_jj4pylfv Jun 19 04:24:37 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:37 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_jj4pylfv" returned: 0 in 0.786s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_jj4pylfv {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:37 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6" returned: 0 in 0.866s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be99f911-a492-4393-9e42-ab9d08091051(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:24:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Creating direct copy from snapshot {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:24:37 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e68a4a9-c604-4591-a55c-af64ed2b6225]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:37 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_jj4pylfv Jun 19 04:24:37 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:37 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 Jun 19 04:24:37 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:38 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051" returned: 0 in 0.910s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:38 devstack cinder-volume[93300]: DEBUG cinder.utils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Path /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764 not found in is_blk_device check {{(pid=93300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:24:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:38 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_jj4pylfv" returned: 1 in 1.006s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_jj4pylfv' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:24:38 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e2ac7b-12bf-420a-9167-8e5bcfbefc93]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:38 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764 Jun 19 04:24:38 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:38 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD Jun 19 04:24:38 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:39 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD" returned: 0 in 1.186s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:39 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 was qcow2, converting to raw {{(pid=93300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:24:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:39 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 Jun 19 04:24:39 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:43 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764" returned: 0 in 5.106s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:43 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7c68c7-f789-498a-ae59-22ad4a125dcc]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:43 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158" returned: 0 in 4.000s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:43 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_tmxbqnjbdevstack@QuobyteHD, size 112.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:24:43 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Converted 112.00 MB image at 27.99 MB/s Jun 19 04:24:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:43 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 Jun 19 04:24:43 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:43 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 1G Jun 19 04:24:43 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:44 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 1G" returned: 0 in 0.680s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:44 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[275b5c1c-117d-4a6e-829e-a53cecbd8ff7]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:44 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051" returned: 0 in 0.909s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:44 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:24:44 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Converted 1024.00 MB image at 200.46 MB/s Jun 19 04:24:44 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764 is being set with open permissions: ugo+rw Jun 19 04:24:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:44 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 Jun 19 04:24:44 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:44 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764 Jun 19 04:24:44 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:45 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764" returned: 0 in 0.625s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-8b93f90a-036f-4141-bd6a-2e79c3d0e764" released by "_copy_volume_from_snapshot" :: held 8.526s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:45 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-39f38e21-f011-4a70-a023-73d472b2a6f6-8b93f90a-036f-4141-bd6a-2e79c3d0e764" released by "_create_volume_from_snapshot" :: held 8.565s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.592s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.754s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158" returned: 0 in 0.745s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] Creating offline snapshot dad13d0d-07b6-4291-a89b-9fd857746abe of volume dcc9d90a-3d4f-4372-9453-5796d4c36f4a {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abade0ac-d189-4678-95e3-2fd47be67822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764', 'volume_size': 1, 'snapshot_id': '39f38e21-f011-4a70-a023-73d472b2a6f6'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eec40d5-9581-499f-afdd-4a6de60e37d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce294ffb-47a7-4e40-8865-bc6d223800f7]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:45 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Volume volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764 (8b93f90a-036f-4141-bd6a-2e79c3d0e764): created successfully Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eec40d5-9581-499f-afdd-4a6de60e37d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Flow 'volume_create_manager' (765ebbf8-ed5c-4683-8245-e315238f2420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:45 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 Jun 19 04:24:45 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:45 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-1c3b1ae0-b173-445a-a8b4-97899c487133 tempest-VolumesDeleteCascade-1286972204 None] Created volume successfully. Jun 19 04:24:45 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a Jun 19 04:24:45 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-be99f911-a492-4393-9e42-ab9d08091051-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-be99f911-a492-4393-9e42-ab9d08091051-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Performing cascade delete. {{(pid=93300) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-39f38e21-f011-4a70-a023-73d472b2a6f6-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-39f38e21-f011-4a70-a023-73d472b2a6f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-quobyte-be99f911-a492-4393-9e42-ab9d08091051" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-be99f911-a492-4393-9e42-ab9d08091051" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-quobyte-39f38e21-f011-4a70-a023-73d472b2a6f6" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-39f38e21-f011-4a70-a023-73d472b2a6f6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Deleting offline snapshot 39f38e21-f011-4a70-a023-73d472b2a6f6 of volume be99f911-a492-4393-9e42-ab9d08091051 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] snapshot_file for this snap is: volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[370d52e5-1cbc-475f-9501-0d9a62bfb500]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:46 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 Jun 19 04:24:46 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:46 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158" returned: 1 in 0.797s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Downloaded image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 ((None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}])) to volume b7672bb5-1e1d-459d-b64d-104e0af7b158 successfully. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Temporary image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 for user f135c8547a674d8bac05e277d2fc9442 is deleted. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Marking volume b7672bb5-1e1d-459d-b64d-104e0af7b158 as bootable. {{(pid=93300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Copying metadata from image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 to b7672bb5-1e1d-459d-b64d-104e0af7b158. {{(pid=93300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Creating volume glance metadata for volume b7672bb5-1e1d-459d-b64d-104e0af7b158 backed by image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbf8626-a2ae-48da-9f62-561fb115e0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7672bb5-1e1d-459d-b64d-104e0af7b158', 'volume_size': 1, 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dffb3ac9be154db7807c947881bed470', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'created_at': datetime.datetime(2026, 6, 19, 2, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab0cc49-aaf4-4bfe-9609-8010de5d101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:46 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Volume volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 (b7672bb5-1e1d-459d-b64d-104e0af7b158): created successfully Jun 19 04:24:46 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab0cc49-aaf4-4bfe-9609-8010de5d101d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Flow 'volume_create_manager' (8d205394-a4c6-4cf2-8231-86149a06cf91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a" returned: 0 in 0.907s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:46 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-7ca940db-7254-4769-b212-fdf2b217558d tempest-VolumesImageMetadata-2145727751 None] Created volume successfully. Jun 19 04:24:46 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe 1G Jun 19 04:24:46 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:46 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6" returned: 0 in 0.996s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be99f911-a492-4393-9e42-ab9d08091051(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:47 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7d60ec-a419-4bab-bf7b-ccc65e1dfe0a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:47 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 Jun 19 04:24:47 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:47 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe 1G" returned: 0 in 0.909s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:47 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe Jun 19 04:24:47 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Acquiring lock "cinder-b7672bb5-1e1d-459d-b64d-104e0af7b158-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Lock "cinder-b7672bb5-1e1d-459d-b64d-104e0af7b158-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Acquiring lock "cinder-quobyte-b7672bb5-1e1d-459d-b64d-104e0af7b158" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Lock "cinder-quobyte-b7672bb5-1e1d-459d-b64d-104e0af7b158" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:47 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e739c81b-2c9e-46c9-bfd7-d78811c39a05]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:47 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 Jun 19 04:24:47 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:47 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051" returned: 0 in 0.971s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:48 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 Jun 19 04:24:48 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:48 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe" returned: 0 in 0.811s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:48 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe is being set with open permissions: ugo+rw Jun 19 04:24:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:48 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe Jun 19 04:24:48 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:48 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158" returned: 0 in 0.956s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:48 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 Jun 19 04:24:48 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:48 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe" returned: 0 in 0.797s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:48 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6" returned: 0 in 0.914s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:48 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.info Jun 19 04:24:48 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:48 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6 Jun 19 04:24:48 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:49 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158" returned: 1 in 0.822s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:49 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158 Jun 19 04:24:49 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:49 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051.39f38e21-f011-4a70-a023-73d472b2a6f6" returned: 0 in 0.662s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-39f38e21-f011-4a70-a023-73d472b2a6f6" released by "_delete_snapshot" :: held 3.687s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-be99f911-a492-4393-9e42-ab9d08091051" released by "delete_snapshot" :: held 3.719s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:49 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.info" returned: 0 in 0.749s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:49 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.info is being set with open permissions: ugo+rw Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:49 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.info Jun 19 04:24:49 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Created reservations ['74dff031-99a8-401e-9437-14fb3daa3d15', '48859271-3415-47bd-824a-eb816a6c4dd3', 'ff960cd2-aa6c-41c0-b561-ae573edf023a', 'eda39d66-2cab-4e8f-b7ee-7e508b21e65b'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:49 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Delete snapshot completed successfully. Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-39f38e21-f011-4a70-a023-73d472b2a6f6-delete_snapshot" released by "delete_snapshot" :: held 3.967s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Snapshots deleted, issuing volume delete {{(pid=93300) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-quobyte-be99f911-a492-4393-9e42-ab9d08091051" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-be99f911-a492-4393-9e42-ab9d08091051" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44dce38-ca8c-425a-b64f-babbdfd07695]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:49 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 Jun 19 04:24:49 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:50 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b7672bb5-1e1d-459d-b64d-104e0af7b158" returned: 0 in 0.685s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Lock "cinder-quobyte-b7672bb5-1e1d-459d-b64d-104e0af7b158" released by "delete_volume" :: held 2.554s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Created reservations ['294abf90-a9a2-4406-8f8a-58cf509d3e9a', '7f406431-c047-4988-8600-8aba32a1c2f5', '8511f471-8bf7-42d5-b518-b3bc75514871', '4b2ab831-d0b8-40f0-8748-dad27b2fd0c1'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:50 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.info" returned: 0 in 0.705s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:50 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:24:50 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.004s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:50 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3964d0c5-8be6-48cd-be5a-34d9318712d8 tempest-VolumesExtendTest-77945022 None] Create snapshot completed successfully Jun 19 04:24:50 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051" returned: 0 in 0.865s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:50 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051 Jun 19 04:24:50 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:50 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.654s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:50 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:51 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Deleted volume successfully. Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9d6d8df6-9af0-40b2-a549-d997529582bb tempest-VolumesImageMetadata-2145727751 None] Lock "cinder-b7672bb5-1e1d-459d-b64d-104e0af7b158-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:51 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-be99f911-a492-4393-9e42-ab9d08091051" returned: 0 in 0.689s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4070013c-3460-49bf-bdb5-f762a6a5f26a tempest-VolumesExtendTest-77945022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4070013c-3460-49bf-bdb5-f762a6a5f26a tempest-VolumesExtendTest-77945022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-be99f911-a492-4393-9e42-ab9d08091051" released by "delete_volume" :: held 1.628s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1f75af-9eee-4edb-8931-ee3c1adc247f]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4070013c-3460-49bf-bdb5-f762a6a5f26a tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Created reservations ['08eb8fe8-8b5f-44b4-8474-bcc100a032be', '02678a28-2616-4507-a10f-aa5911ed1279', 'bf345b3e-0bb5-4795-ab82-c770839e26cb', '14016871-eb64-4578-814c-014876a924c3'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:51 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a Jun 19 04:24:51 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:51 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:24:51 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:52 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.759s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:52 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:52 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Deleted volume successfully. Jun 19 04:24:52 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8a2c03f-5709-4c0e-87e9-e25d364c81a6 tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-be99f911-a492-4393-9e42-ab9d08091051-delete_volume" released by "delete_volume" :: held 6.649s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4070013c-3460-49bf-bdb5-f762a6a5f26a tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a" returned: 0 in 0.954s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4070013c-3460-49bf-bdb5-f762a6a5f26a tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe 2G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-8b93f90a-036f-4141-bd6a-2e79c3d0e764-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-8b93f90a-036f-4141-bd6a-2e79c3d0e764-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "cinder-quobyte-8b93f90a-036f-4141-bd6a-2e79c3d0e764" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-8b93f90a-036f-4141-bd6a-2e79c3d0e764" acquired by "delete_volume" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4070013c-3460-49bf-bdb5-f762a6a5f26a tempest-VolumesExtendTest-77945022 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe 2G" returned: 0 in 0.211s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4070013c-3460-49bf-bdb5-f762a6a5f26a tempest-VolumesExtendTest-77945022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.213s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:52 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[97daf517-95a2-4baa-b48f-55b9aff4369b]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:52 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4070013c-3460-49bf-bdb5-f762a6a5f26a tempest-VolumesExtendTest-77945022 None] Extend volume completed successfully. Jun 19 04:24:52 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764 Jun 19 04:24:52 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:53 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764" returned: 0 in 0.853s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:53 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764 Jun 19 04:24:53 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Acquiring lock "cinder-dad13d0d-07b6-4291-a89b-9fd857746abe-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Lock "cinder-dad13d0d-07b6-4291-a89b-9fd857746abe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Acquiring lock "cinder-quobyte-dcc9d90a-3d4f-4372-9453-5796d4c36f4a" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Lock "cinder-quobyte-dcc9d90a-3d4f-4372-9453-5796d4c36f4a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Acquiring lock "cinder-quobyte-dad13d0d-07b6-4291-a89b-9fd857746abe" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Lock "cinder-quobyte-dad13d0d-07b6-4291-a89b-9fd857746abe" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Deleting offline snapshot dad13d0d-07b6-4291-a89b-9fd857746abe of volume dcc9d90a-3d4f-4372-9453-5796d4c36f4a {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:24:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] snapshot_file for this snap is: volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:24:53 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10e9353-a430-4873-a0c4-69149ab170b1]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:54 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe Jun 19 04:24:54 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Flow 'volume_create_manager' (4dd05659-f014-428d-afb7-edf3cbcc591d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b20c3f5-41cc-4f4e-935f-0e57658d3521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b20c3f5-41cc-4f4e-935f-0e57658d3521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-712014856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8cb24e-3d03-4e07-83c6-5fda3b666de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac20dc847fb4be1a17f2ef6e23af969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:54Z,use_quota=True,user_id='2d8e7ad9189c4272a465ce3861caa569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0181f9-850c-43fa-8e18-d55564761f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0181f9-850c-43fa-8e18-d55564761f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a04a8f1-61e0-4fda-bb37-739df080dde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a04a8f1-61e0-4fda-bb37-739df080dde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a8cb24e-3d03-4e07-83c6-5fda3b666de7', 'volume_name': 'volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e6db77-948d-433c-8e30-949a5b7eb94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e6db77-948d-433c-8e30-949a5b7eb94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72f1f48-79b2-4d53-9153-716c5f07c800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:54 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Volume 0a8cb24e-3d03-4e07-83c6-5fda3b666de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7', 'volume_size': 1} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-712014856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8cb24e-3d03-4e07-83c6-5fda3b666de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac20dc847fb4be1a17f2ef6e23af969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:54Z,use_quota=True,user_id='2d8e7ad9189c4272a465ce3861caa569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Creating volume 0a8cb24e-3d03-4e07-83c6-5fda3b666de7 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:54 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:54 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8b93f90a-036f-4141-bd6a-2e79c3d0e764" returned: 0 in 0.756s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:54 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 1073741824 Jun 19 04:24:54 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-quobyte-8b93f90a-036f-4141-bd6a-2e79c3d0e764" released by "delete_volume" :: held 1.669s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Created reservations ['3e35006f-1e6a-4908-85da-8517491cd122', '38bb7bf7-a7a7-4354-a6d6-b70a08100aaf', 'd6b865cb-1fc8-4f3c-b79d-a437ac59960d', 'b1dddeb9-81ba-4858-9186-8b1a900ec9e6'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:54 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:24:54 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:54 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe" returned: 0 in 0.861s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[136a4fcf-05a1-4d67-ad83-92f9c7de67e5]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:54 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a Jun 19 04:24:54 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:55 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.755s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:55 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:55 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Deleted volume successfully. Jun 19 04:24:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d828f9fe-136f-438e-b17d-aff00064959a tempest-VolumesDeleteCascade-1286972204 None] Lock "cinder-8b93f90a-036f-4141-bd6a-2e79c3d0e764-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:55 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 1073741824" returned: 0 in 1.006s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:55 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 Jun 19 04:24:55 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:55 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a" returned: 0 in 0.910s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:55 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe Jun 19 04:24:55 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:56 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7" returned: 0 in 0.916s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72f1f48-79b2-4d53-9153-716c5f07c800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e09adbe-c967-4cb1-a06c-d292b0ca2d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:56 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Volume volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 (0a8cb24e-3d03-4e07-83c6-5fda3b666de7): created successfully Jun 19 04:24:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e09adbe-c967-4cb1-a06c-d292b0ca2d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Flow 'volume_create_manager' (4dd05659-f014-428d-afb7-edf3cbcc591d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:56 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-9ca03d07-6068-434c-8b47-0c9a8f6196f9 tempest-SnapshotMetadataTestJSON-545259948 None] Created volume successfully. Jun 19 04:24:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-7a1d91e4-2ad7-4b3f-bded-fa123d6cee6b req-05e12e27-5dc8-415a-bddc-ff9d2ba6b5ef tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-7a1d91e4-2ad7-4b3f-bded-fa123d6cee6b req-05e12e27-5dc8-415a-bddc-ff9d2ba6b5ef tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:56 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c91119b-82bd-42e5-b7c3-a75c7a9bcb7d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7a1d91e4-2ad7-4b3f-bded-fa123d6cee6b req-05e12e27-5dc8-415a-bddc-ff9d2ba6b5ef tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:56 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5 Jun 19 04:24:56 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:56 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe" returned: 0 in 1.093s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:56 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe Jun 19 04:24:56 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:57 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-7a1d91e4-2ad7-4b3f-bded-fa123d6cee6b req-05e12e27-5dc8-415a-bddc-ff9d2ba6b5ef tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5" returned: 0 in 0.887s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-7a1d91e4-2ad7-4b3f-bded-fa123d6cee6b req-05e12e27-5dc8-415a-bddc-ff9d2ba6b5ef tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.910s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:57 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-7a1d91e4-2ad7-4b3f-bded-fa123d6cee6b req-05e12e27-5dc8-415a-bddc-ff9d2ba6b5ef tempest-TestInstancesWithCinderVolumes-921932341 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8693f9af-ffd1-4e7e-aaad-e8bad62c6149', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:24:57 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-7a1d91e4-2ad7-4b3f-bded-fa123d6cee6b req-05e12e27-5dc8-415a-bddc-ff9d2ba6b5ef tempest-TestInstancesWithCinderVolumes-921932341 None] attachment_update completed successfully. Jun 19 04:24:57 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a.dad13d0d-07b6-4291-a89b-9fd857746abe" returned: 0 in 0.761s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Lock "cinder-quobyte-dad13d0d-07b6-4291-a89b-9fd857746abe" released by "_delete_snapshot" :: held 3.784s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Lock "cinder-quobyte-dcc9d90a-3d4f-4372-9453-5796d4c36f4a" released by "delete_snapshot" :: held 3.812s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:57 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] Creating offline snapshot 133afb2a-f2d9-477c-a3d4-54068723412b of volume 0a8cb24e-3d03-4e07-83c6-5fda3b666de7 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:24:57 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7909db8-759d-4cc8-bdea-57524f83ae43]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:57 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Created reservations ['d371a304-aa7c-4e7a-b4a1-28dc0c164680', '1acbe881-840e-4c07-8d59-fc311ada26a2', 'a65a39ba-4537-4413-990f-bfe9f0370e50', '4f792080-6c6d-4620-9c3b-175cfe21533e'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:57 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Delete snapshot completed successfully. Jun 19 04:24:57 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 Jun 19 04:24:57 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c93dc588-ce25-473f-9fa3-09ac45cc1b25 tempest-VolumesExtendTest-77945022 None] Lock "cinder-dad13d0d-07b6-4291-a89b-9fd857746abe-delete_snapshot" released by "delete_snapshot" :: held 3.997s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Acquiring lock "cinder-dcc9d90a-3d4f-4372-9453-5796d4c36f4a-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Lock "cinder-dcc9d90a-3d4f-4372-9453-5796d4c36f4a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Acquiring lock "cinder-quobyte-dcc9d90a-3d4f-4372-9453-5796d4c36f4a" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Lock "cinder-quobyte-dcc9d90a-3d4f-4372-9453-5796d4c36f4a" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:58 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3bf2d5-531f-4c4b-a29e-3836ec650491]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:58 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a Jun 19 04:24:58 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:58 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7" returned: 0 in 0.851s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:58 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b 1G Jun 19 04:24:58 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:59 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a" returned: 0 in 0.939s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:59 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a Jun 19 04:24:59 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:59 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b 1G" returned: 0 in 0.983s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:59 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b Jun 19 04:24:59 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:59 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-dcc9d90a-3d4f-4372-9453-5796d4c36f4a" returned: 0 in 0.727s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Lock "cinder-quobyte-dcc9d90a-3d4f-4372-9453-5796d4c36f4a" released by "delete_volume" :: held 1.752s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Created reservations ['115dc733-16c3-47ae-b8c3-2dfda2fbf323', '5318ff1e-e153-4d42-880a-be4e44e8a921', '05ecd637-8792-4549-90cf-5fc1246e0341', '93141cf0-cbd5-4ade-8776-e2bd7eb048c6'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:00 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:00 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Flow 'volume_create_manager' (8c53ff22-1a96-4124-ba58-47e22d30babf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c89d804-cbb5-43aa-848a-d5ed6e12acc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c89d804-cbb5-43aa-848a-d5ed6e12acc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-787274024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158be822-7983-4d4d-bb0e-7c41f7c9c484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf7404184b74ffeb7f8ad1df41898da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:00Z,use_quota=True,user_id='5ff0d8d21357488d904c20cc711d15f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fabea20-f838-4af1-9fcf-c057f880d2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fabea20-f838-4af1-9fcf-c057f880d2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fbc369-1563-471b-ab46-dabb13cbab0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fbc369-1563-471b-ab46-dabb13cbab0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158be822-7983-4d4d-bb0e-7c41f7c9c484', 'volume_name': 'volume-158be822-7983-4d4d-bb0e-7c41f7c9c484', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c902d2-1e9d-4441-990c-8e7f3654b68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c902d2-1e9d-4441-990c-8e7f3654b68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25aed1e9-73c5-457e-ba66-67faa3fdc6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:00 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Volume 158be822-7983-4d4d-bb0e-7c41f7c9c484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158be822-7983-4d4d-bb0e-7c41f7c9c484', 'volume_size': 1} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:00 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b" returned: 0 in 0.854s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:00 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b is being set with open permissions: ugo+rw Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:00 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b Jun 19 04:25:00 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:00 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.689s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:00 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Deleted volume successfully. Jun 19 04:25:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5c09dc2a-38f1-4e13-95b3-ffcd9b44facc tempest-VolumesExtendTest-77945022 None] Lock "cinder-dcc9d90a-3d4f-4372-9453-5796d4c36f4a-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:01 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b" returned: 0 in 0.762s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:01 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.info Jun 19 04:25:01 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:01 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.info" returned: 0 in 0.690s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:01 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.info is being set with open permissions: ugo+rw Jun 19 04:25:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:01 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.info Jun 19 04:25:01 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:02 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.info" returned: 0 in 0.762s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.013s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.362s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-787274024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158be822-7983-4d4d-bb0e-7c41f7c9c484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf7404184b74ffeb7f8ad1df41898da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:00Z,use_quota=True,user_id='5ff0d8d21357488d904c20cc711d15f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Creating volume 158be822-7983-4d4d-bb0e-7c41f7c9c484 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:02 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:25:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-158be822-7983-4d4d-bb0e-7c41f7c9c484 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:02 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-158be822-7983-4d4d-bb0e-7c41f7c9c484 1073741824 Jun 19 04:25:02 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:02 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-53b19e76-2f11-4e3e-bf2a-9a88fe59dcb9 tempest-SnapshotMetadataTestJSON-545259948 None] Create snapshot completed successfully Jun 19 04:25:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Acquiring lock "cinder-133afb2a-f2d9-477c-a3d4-54068723412b-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:03 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-158be822-7983-4d4d-bb0e-7c41f7c9c484 1073741824" returned: 0 in 1.127s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "cinder-133afb2a-f2d9-477c-a3d4-54068723412b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Acquiring lock "cinder-quobyte-0a8cb24e-3d03-4e07-83c6-5fda3b666de7" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "cinder-quobyte-0a8cb24e-3d03-4e07-83c6-5fda3b666de7" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Acquiring lock "cinder-quobyte-133afb2a-f2d9-477c-a3d4-54068723412b" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-158be822-7983-4d4d-bb0e-7c41f7c9c484 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "cinder-quobyte-133afb2a-f2d9-477c-a3d4-54068723412b" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Deleting offline snapshot 133afb2a-f2d9-477c-a3d4-54068723412b of volume 0a8cb24e-3d03-4e07-83c6-5fda3b666de7 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:25:03 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-158be822-7983-4d4d-bb0e-7c41f7c9c484 Jun 19 04:25:03 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] snapshot_file for this snap is: volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:25:03 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d194d253-2168-4f31-b970-202bdcd0112b]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:04 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b Jun 19 04:25:04 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:04 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-158be822-7983-4d4d-bb0e-7c41f7c9c484" returned: 0 in 0.888s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25aed1e9-73c5-457e-ba66-67faa3fdc6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158be822-7983-4d4d-bb0e-7c41f7c9c484', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ca5c3e-7cbd-4abf-a295-052bcd80e900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:04 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Volume volume-158be822-7983-4d4d-bb0e-7c41f7c9c484 (158be822-7983-4d4d-bb0e-7c41f7c9c484): created successfully Jun 19 04:25:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ca5c3e-7cbd-4abf-a295-052bcd80e900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Flow 'volume_create_manager' (8c53ff22-1a96-4124-ba58-47e22d30babf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:04 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-774dc5b0-3c26-4241-88f9-d285e46ded68 tempest-VolumesTransfersV355Test-1488694734 None] Created volume successfully. Jun 19 04:25:04 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b" returned: 0 in 0.978s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:25:04 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[29135c59-7052-4d12-9707-b58d8c373394]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:05 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 Jun 19 04:25:05 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:05 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7" returned: 0 in 0.903s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:05 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b Jun 19 04:25:05 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:06 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d9aee154-a3af-46ec-8b6e-8fce5f8ed9c7 tempest-VolumesTransfersV355Test-700306697 None] Transfer volume completed successfully. Jun 19 04:25:06 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b" returned: 0 in 0.874s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:06 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b Jun 19 04:25:06 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Flow 'volume_create_manager' (e7d8e278-591a-47b1-aac3-1d3245adb78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5aeb36-6895-4429-a29f-b726a9592f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5aeb36-6895-4429-a29f-b726a9592f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1826505541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d13ff3f-0bde-44f0-8139-3f6f60f549e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='723137710a1248f7a478f95996704309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:07Z,use_quota=True,user_id='62e24a7acc554aef8e9327c49ee1f18e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75bd8e86-bac7-4f17-8819-63c43d404544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75bd8e86-bac7-4f17-8819-63c43d404544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f938ee02-e4c7-4e38-b5a3-c3d309694d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f938ee02-e4c7-4e38-b5a3-c3d309694d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d13ff3f-0bde-44f0-8139-3f6f60f549e3', 'volume_name': 'volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5102bbc-4e73-4702-9aee-482488d74b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5102bbc-4e73-4702-9aee-482488d74b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83890ef-73b6-4665-8d89-ece442b22c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:06 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Volume 0d13ff3f-0bde-44f0-8139-3f6f60f549e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3', 'volume_size': 1} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1826505541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d13ff3f-0bde-44f0-8139-3f6f60f549e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='723137710a1248f7a478f95996704309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:07Z,use_quota=True,user_id='62e24a7acc554aef8e9327c49ee1f18e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Creating volume 0d13ff3f-0bde-44f0-8139-3f6f60f549e3 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:06 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:06 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 1073741824 Jun 19 04:25:06 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-4eff9c78-57da-4dee-9c2d-b709b868be44 req-56d4216a-f7bf-47bf-a1bb-02cbfd4b1b06 tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:07 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7.133afb2a-f2d9-477c-a3d4-54068723412b" returned: 0 in 0.757s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "cinder-quobyte-133afb2a-f2d9-477c-a3d4-54068723412b" released by "_delete_snapshot" :: held 3.639s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "cinder-quobyte-0a8cb24e-3d03-4e07-83c6-5fda3b666de7" released by "delete_snapshot" :: held 3.687s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:07 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Created reservations ['68b60b4c-2ddb-4499-8356-0d65cb3aabd1', '88d50408-c6d1-4b0e-9404-a7a664e3c868', 'd51e2e8c-aac5-4448-961b-b922d496358c', 'c8d88315-ef0f-42ba-9e36-155e31d993b2'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:07 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Delete snapshot completed successfully. Jun 19 04:25:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-10100cae-8361-4dac-ab6b-a275862ed978 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "cinder-133afb2a-f2d9-477c-a3d4-54068723412b-delete_snapshot" released by "delete_snapshot" :: held 3.854s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:07 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 1073741824" returned: 0 in 0.889s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Acquiring lock "cinder-158be822-7983-4d4d-bb0e-7c41f7c9c484-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Lock "cinder-158be822-7983-4d4d-bb0e-7c41f7c9c484-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:07 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 Jun 19 04:25:07 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Acquiring lock "cinder-quobyte-158be822-7983-4d4d-bb0e-7c41f7c9c484" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Lock "cinder-quobyte-158be822-7983-4d4d-bb0e-7c41f7c9c484" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:07 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[02674c28-2b23-4820-ae4e-c2b6873f4758]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-158be822-7983-4d4d-bb0e-7c41f7c9c484 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:08 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-158be822-7983-4d4d-bb0e-7c41f7c9c484 Jun 19 04:25:08 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Acquiring lock "cinder-0a8cb24e-3d03-4e07-83c6-5fda3b666de7-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "cinder-0a8cb24e-3d03-4e07-83c6-5fda3b666de7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:08 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Acquiring lock "cinder-quobyte-0a8cb24e-3d03-4e07-83c6-5fda3b666de7" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" returned: 0 in 0.652s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-4eff9c78-57da-4dee-9c2d-b709b868be44 req-56d4216a-f7bf-47bf-a1bb-02cbfd4b1b06 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.554s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "cinder-quobyte-0a8cb24e-3d03-4e07-83c6-5fda3b666de7" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[428862a5-d3f6-4e03-a533-2f2e594fc46e]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-4eff9c78-57da-4dee-9c2d-b709b868be44 req-56d4216a-f7bf-47bf-a1bb-02cbfd4b1b06 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83890ef-73b6-4665-8d89-ece442b22c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429b0fc1-c6c1-4adc-ad59-2224d0324fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd84b18e-2786-4479-9155-156f02beba6d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:08 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Volume volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 (0d13ff3f-0bde-44f0-8139-3f6f60f549e3): created successfully Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429b0fc1-c6c1-4adc-ad59-2224d0324fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Flow 'volume_create_manager' (e7d8e278-591a-47b1-aac3-1d3245adb78f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:08 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-71b0e8bf-5ce6-4879-a6fb-2bedf7732073 tempest-VolumesSnapshotListTestJSON-311886685 None] Created volume successfully. Jun 19 04:25:08 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d Jun 19 04:25:08 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:08 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 Jun 19 04:25:08 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:08 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-158be822-7983-4d4d-bb0e-7c41f7c9c484" returned: 0 in 0.782s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-158be822-7983-4d4d-bb0e-7c41f7c9c484 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:08 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-158be822-7983-4d4d-bb0e-7c41f7c9c484 Jun 19 04:25:08 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:09 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7" returned: 0 in 0.860s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:09 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-4eff9c78-57da-4dee-9c2d-b709b868be44 req-56d4216a-f7bf-47bf-a1bb-02cbfd4b1b06 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d" returned: 0 in 0.914s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-4eff9c78-57da-4dee-9c2d-b709b868be44 req-56d4216a-f7bf-47bf-a1bb-02cbfd4b1b06 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.955s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.087s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:09 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7 Jun 19 04:25:09 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:09 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] Creating offline snapshot 594bc6c5-0832-4c1d-8c1f-63d78c788535 of volume 0d13ff3f-0bde-44f0-8139-3f6f60f549e3 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-158be822-7983-4d4d-bb0e-7c41f7c9c484" returned: 0 in 0.737s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3de289-ad17-4ce5-9f42-479a19d8d743]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Lock "cinder-quobyte-158be822-7983-4d4d-bb0e-7c41f7c9c484" released by "delete_volume" :: held 1.587s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-4eff9c78-57da-4dee-9c2d-b709b868be44 req-56d4216a-f7bf-47bf-a1bb-02cbfd4b1b06 tempest-TestInstancesWithCinderVolumes-921932341 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-055696c1-263f-4496-85e2-6b7e55b34d0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0efd2b73-e65c-451b-89db-a504bf50fdc0', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Created reservations ['ecaf10af-f75e-4481-986a-d9adede1cf9f', 'ef404911-b473-40ff-806e-02fe658f2bcc', 'c64d14cd-0f6f-4c8b-9880-14ae77edecf8', '0f0e4042-1dae-4a13-b792-57302339218f'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:09 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 Jun 19 04:25:09 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:09 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-4eff9c78-57da-4dee-9c2d-b709b868be44 req-56d4216a-f7bf-47bf-a1bb-02cbfd4b1b06 tempest-TestInstancesWithCinderVolumes-921932341 None] attachment_update completed successfully. Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:09 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:09 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:10 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0a8cb24e-3d03-4e07-83c6-5fda3b666de7" returned: 0 in 0.692s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "cinder-quobyte-0a8cb24e-3d03-4e07-83c6-5fda3b666de7" released by "delete_volume" :: held 1.635s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Created reservations ['4b4bac2e-4515-4375-ac48-a8b39b7832b9', '5253fefe-9ba9-45ed-9299-be2d9add8b8f', '722acc63-0c8e-48b6-9523-1a1c0fb840f1', 'fa9bdc20-b1aa-4226-92f4-657bf145d122'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:10 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:10 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:10 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" returned: 0 in 0.897s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:10 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 1G Jun 19 04:25:10 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:10 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.756s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:10 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Deleted volume successfully. Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-81e9f5f0-1ed3-4f21-9d37-c8f935e3f2b3 tempest-VolumesTransfersV355Test-1192319244 None] Lock "cinder-158be822-7983-4d4d-bb0e-7c41f7c9c484-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Flow 'volume_create_manager' (c03d8d5f-8ee7-4064-bc6c-02cbbde653f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b7b7b9-881b-49dd-9f5b-fba9a21aac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b7b7b9-881b-49dd-9f5b-fba9a21aac18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1212512893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd8aee7-a569-48e5-a2c8-04f93688a18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf7404184b74ffeb7f8ad1df41898da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:11Z,use_quota=True,user_id='5ff0d8d21357488d904c20cc711d15f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1b9b7f-f160-4b47-ad8b-bf250df134ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1b9b7f-f160-4b47-ad8b-bf250df134ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e2778a-a5f8-497d-b3a7-b0a2dde8de65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e2778a-a5f8-497d-b3a7-b0a2dde8de65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd8aee7-a569-48e5-a2c8-04f93688a18c', 'volume_name': 'volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30c8993-4847-48d5-9c4b-c66d13abecd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:10 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30c8993-4847-48d5-9c4b-c66d13abecd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:11 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38afae0-e38c-44ff-a7db-1ccc0049a554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:11 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Volume 9cd8aee7-a569-48e5-a2c8-04f93688a18c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c', 'volume_size': 1} Jun 19 04:25:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.850s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:11 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:11 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:11 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Deleted volume successfully. Jun 19 04:25:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-144c3a03-e9a4-4928-832d-165b5e213427 tempest-SnapshotMetadataTestJSON-545259948 None] Lock "cinder-0a8cb24e-3d03-4e07-83c6-5fda3b666de7-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:11 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 1G" returned: 0 in 1.210s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:11 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 Jun 19 04:25:11 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:12 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535" returned: 0 in 0.730s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:12 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 is being set with open permissions: ugo+rw Jun 19 04:25:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:12 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 Jun 19 04:25:12 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:12 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535" returned: 0 in 0.655s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:13 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.info Jun 19 04:25:13 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:13 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.info" returned: 0 in 0.671s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:13 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.info is being set with open permissions: ugo+rw Jun 19 04:25:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:13 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.info Jun 19 04:25:13 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:14 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.info" returned: 0 in 0.659s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.935s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.358s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1212512893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd8aee7-a569-48e5-a2c8-04f93688a18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf7404184b74ffeb7f8ad1df41898da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:11Z,use_quota=True,user_id='5ff0d8d21357488d904c20cc711d15f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Creating volume 9cd8aee7-a569-48e5-a2c8-04f93688a18c {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:14 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:25:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:14 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c 1073741824 Jun 19 04:25:14 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:14 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e0032e7e-e131-497d-9b19-1c8c24878278 tempest-VolumesSnapshotListTestJSON-311886685 None] Create snapshot completed successfully Jun 19 04:25:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:15 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c 1073741824" returned: 0 in 1.002s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:15 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c Jun 19 04:25:15 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Flow 'volume_create_manager' (b5a75e4c-f489-4895-a093-daebb6dbdc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc87c15-e640-47dd-891e-67f8120e1e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc87c15-e640-47dd-891e-67f8120e1e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2110534546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f81d967-7934-44de-9f4e-4f1b1de69dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb24480a4e044fbc8ff7218580dcd11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:15Z,use_quota=True,user_id='1d9e7516a47e4a84962c32b38107208d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16916e07-226f-4743-94cd-f52adfc38aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16916e07-226f-4743-94cd-f52adfc38aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f927027f-7883-413b-b1f5-d0712addc197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f927027f-7883-413b-b1f5-d0712addc197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f81d967-7934-44de-9f4e-4f1b1de69dce', 'volume_name': 'volume-8f81d967-7934-44de-9f4e-4f1b1de69dce', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59e837a-0d76-4ba8-8fee-4e0cf5a4ecc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59e837a-0d76-4ba8-8fee-4e0cf5a4ecc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9155151-b137-417c-8185-4560ff967acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:15 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Volume 8f81d967-7934-44de-9f4e-4f1b1de69dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f81d967-7934-44de-9f4e-4f1b1de69dce', 'volume_size': 1} Jun 19 04:25:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:16 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c" returned: 0 in 0.722s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.358s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] Creating offline snapshot ae0b30d5-5d48-43f0-bb2d-f623daba7a5e of volume 0d13ff3f-0bde-44f0-8139-3f6f60f549e3 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:25:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38afae0-e38c-44ff-a7db-1ccc0049a554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47d6b58-3cab-4f63-87b1-cd342a08b7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:16 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f9bb92-e35e-47c7-85b3-edb36eda4c6b]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:16 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Volume volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c (9cd8aee7-a569-48e5-a2c8-04f93688a18c): created successfully Jun 19 04:25:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47d6b58-3cab-4f63-87b1-cd342a08b7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Flow 'volume_create_manager' (c03d8d5f-8ee7-4064-bc6c-02cbbde653f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-90110fc4-75c4-4a0e-a9e8-cc46ae06fd1a tempest-VolumesTransfersV355Test-1488694734 None] Created volume successfully. Jun 19 04:25:16 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 Jun 19 04:25:16 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:17 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535" returned: 0 in 0.829s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:25:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:17 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e 1G Jun 19 04:25:17 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Acquiring lock "cinder-9cd8aee7-a569-48e5-a2c8-04f93688a18c-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Lock "cinder-9cd8aee7-a569-48e5-a2c8-04f93688a18c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Acquiring lock "cinder-quobyte-9cd8aee7-a569-48e5-a2c8-04f93688a18c" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Lock "cinder-quobyte-9cd8aee7-a569-48e5-a2c8-04f93688a18c" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:17 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8267697-aae4-4aa7-b914-e3b61ec89bdd]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:17 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c Jun 19 04:25:17 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:17 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e 1G" returned: 0 in 0.907s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:17 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e Jun 19 04:25:17 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:18 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c" returned: 0 in 0.782s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:18 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c Jun 19 04:25:18 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:18 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e" returned: 0 in 0.737s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:18 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e is being set with open permissions: ugo+rw Jun 19 04:25:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:18 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e Jun 19 04:25:18 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:19 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cd8aee7-a569-48e5-a2c8-04f93688a18c" returned: 0 in 0.673s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Lock "cinder-quobyte-9cd8aee7-a569-48e5-a2c8-04f93688a18c" released by "delete_volume" :: held 1.501s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Created reservations ['e52c3293-dd92-4f8d-9910-537938438fcc', '2a0844f2-0a54-45d2-b1da-35cb88646455', '9933e116-0127-4eac-9321-34d11edec136', '1c5f9a0b-f7f1-4086-96a4-155fa689660d'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:19 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:19 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:19 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:19 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:19 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e" returned: 0 in 0.719s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.293s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.912s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2110534546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f81d967-7934-44de-9f4e-4f1b1de69dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb24480a4e044fbc8ff7218580dcd11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:15Z,use_quota=True,user_id='1d9e7516a47e4a84962c32b38107208d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Creating volume 8f81d967-7934-44de-9f4e-4f1b1de69dce {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:19 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8f81d967-7934-44de-9f4e-4f1b1de69dce 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:19 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8f81d967-7934-44de-9f4e-4f1b1de69dce 1073741824 Jun 19 04:25:19 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:19 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8ebee437-584c-43d8-aea9-77cf51502c98 tempest-VolumesSnapshotListTestJSON-311886685 None] Create snapshot completed successfully Jun 19 04:25:19 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-e8c6e463-e59e-4de1-8ed3-9908e614023e req-2feb15c9-df04-4810-8849-1734f6d5bcfe tempest-TestInstancesWithCinderVolumes-921932341 None] Terminate volume connection completed successfully. Jun 19 04:25:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-e8c6e463-e59e-4de1-8ed3-9908e614023e req-2feb15c9-df04-4810-8849-1734f6d5bcfe tempest-TestInstancesWithCinderVolumes-921932341 None] Deleting attachment 8693f9af-ffd1-4e7e-aaad-e8bad62c6149. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:25:20 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.814s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:20 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:25:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 29 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:25:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:25:20 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.809s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:20 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Deleted volume successfully. Jun 19 04:25:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ebf524b7-898f-4e31-9873-01ec509c55a3 tempest-VolumesTransfersV355Test-1192319244 None] Lock "cinder-9cd8aee7-a569-48e5-a2c8-04f93688a18c-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:20 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8f81d967-7934-44de-9f4e-4f1b1de69dce 1073741824" returned: 0 in 0.997s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8f81d967-7934-44de-9f4e-4f1b1de69dce {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:20 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8f81d967-7934-44de-9f4e-4f1b1de69dce Jun 19 04:25:20 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:21 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8f81d967-7934-44de-9f4e-4f1b1de69dce" returned: 0 in 0.697s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.915s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] Creating offline snapshot d8e4a17e-0b10-4e0a-bbbb-4a732b66447c of volume 0d13ff3f-0bde-44f0-8139-3f6f60f549e3 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9155151-b137-417c-8185-4560ff967acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f81d967-7934-44de-9f4e-4f1b1de69dce', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3877df40-23b9-4ebc-a111-6d115152d7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c7262b-24f8-47d6-a5da-76e5980e9b38]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:21 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Volume volume-8f81d967-7934-44de-9f4e-4f1b1de69dce (8f81d967-7934-44de-9f4e-4f1b1de69dce): created successfully Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3877df40-23b9-4ebc-a111-6d115152d7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Flow 'volume_create_manager' (b5a75e4c-f489-4895-a093-daebb6dbdc49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:21 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-06685f21-8534-49c3-8857-cee749a92893 tempest-VolumesTransfersV357Test-1494041048 None] Created volume successfully. Jun 19 04:25:21 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e Jun 19 04:25:21 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "cinder-77eb6e3d-9ba7-46ae-9111-8b896b3597c5-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "cinder-77eb6e3d-9ba7-46ae-9111-8b896b3597c5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "cinder-quobyte-77eb6e3d-9ba7-46ae-9111-8b896b3597c5" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "cinder-quobyte-77eb6e3d-9ba7-46ae-9111-8b896b3597c5" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8efdcf-4244-4479-bcb1-7107f34a2f08]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:21 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5 Jun 19 04:25:21 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e" returned: 0 in 1.166s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:22 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:25:22 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:22 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c 1G Jun 19 04:25:22 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:22 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5" returned: 0 in 1.099s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:22 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5 Jun 19 04:25:22 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:23 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2579a92f-e850-417a-a579-a6f4a945967b tempest-VolumesTransfersV357Test-47516031 None] Transfer volume completed successfully. Jun 19 04:25:23 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-77eb6e3d-9ba7-46ae-9111-8b896b3597c5" returned: 0 in 0.906s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:23 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "cinder-quobyte-77eb6e3d-9ba7-46ae-9111-8b896b3597c5" released by "delete_volume" :: held 2.050s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:23 devstack cinder-volume[93300]: WARNING cinder.quota [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-497351910-1741422122 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-497351910-1741422122, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:25:23 devstack cinder-volume[93300]: WARNING cinder.quota [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-497351910-1741422122 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-497351910-1741422122, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:25:23 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Created reservations ['47866af0-2102-4324-adaa-1d05ebdd788b', '2a592c59-a5a5-46b2-933d-df49e2a72bb1', '429a4c24-bdd7-4fa5-bfed-dd4a112d9351', '4a3e2390-5d4f-4fbb-8838-3c24339fde89'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:23 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c 1G" returned: 0 in 1.270s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:23 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c Jun 19 04:25:23 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:23 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:23 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Acquiring lock "cinder-8f81d967-7934-44de-9f4e-4f1b1de69dce-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:24 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c" returned: 0 in 0.967s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:24 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c is being set with open permissions: ugo+rw Jun 19 04:25:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Lock "cinder-8f81d967-7934-44de-9f4e-4f1b1de69dce-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:24 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c Jun 19 04:25:24 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Acquiring lock "cinder-quobyte-8f81d967-7934-44de-9f4e-4f1b1de69dce" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Lock "cinder-quobyte-8f81d967-7934-44de-9f4e-4f1b1de69dce" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:24 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7352618b-1ba2-4355-b682-8af3cfa913b9]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8f81d967-7934-44de-9f4e-4f1b1de69dce {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:24 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.060s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:24 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:24 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Deleted volume successfully. Jun 19 04:25:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-df1256e6-4815-436a-aeea-c931c533aa8b tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "cinder-77eb6e3d-9ba7-46ae-9111-8b896b3597c5-delete_volume" released by "delete_volume" :: held 3.399s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:24 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8f81d967-7934-44de-9f4e-4f1b1de69dce Jun 19 04:25:24 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:25 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c" returned: 0 in 0.802s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.361s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:25 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3fa214b2-db7c-4abe-bb12-572d5f0a6b9a tempest-VolumesSnapshotListTestJSON-311886685 None] Create snapshot completed successfully Jun 19 04:25:25 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8f81d967-7934-44de-9f4e-4f1b1de69dce" returned: 0 in 0.898s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8f81d967-7934-44de-9f4e-4f1b1de69dce {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:25 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8f81d967-7934-44de-9f4e-4f1b1de69dce Jun 19 04:25:25 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:26 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8f81d967-7934-44de-9f4e-4f1b1de69dce" returned: 0 in 0.656s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Lock "cinder-quobyte-8f81d967-7934-44de-9f4e-4f1b1de69dce" released by "delete_volume" :: held 1.597s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Created reservations ['380439bb-6a4a-48b3-8098-656e036b6869', '095d53fa-0aa9-4936-aa54-c4d39df5c7ea', '22f4d6b5-6b59-477b-9767-e3b450e6037c', '5f398454-bcf6-4597-be8e-dea3ff3cd217'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:26 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:26 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Flow 'volume_create_manager' (675ed212-a3a9-4315-90cf-750c4c64699a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2dac59-e758-4e1f-9fff-9e6a9b4bcdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2dac59-e758-4e1f-9fff-9e6a9b4bcdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-359122556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0642346-f5ac-4624-bb8d-7fdffbb1030c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14d8331302634fceb460eb6c8d6f9c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:27Z,use_quota=True,user_id='f3e01f15c0894f56bc2fa9611cb36f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef7b423-675c-4868-9a2a-8a011790f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef7b423-675c-4868-9a2a-8a011790f28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998da16c-58a0-4909-9588-10cd496f33bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998da16c-58a0-4909-9588-10cd496f33bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0642346-f5ac-4624-bb8d-7fdffbb1030c', 'volume_name': 'volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f503a3e-247b-45a2-9190-89f21ab72452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f503a3e-247b-45a2-9190-89f21ab72452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d969467-98a5-4742-8501-9fde611dbf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:26 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Volume c0642346-f5ac-4624-bb8d-7fdffbb1030c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c', 'volume_size': 1} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-359122556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0642346-f5ac-4624-bb8d-7fdffbb1030c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14d8331302634fceb460eb6c8d6f9c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:27Z,use_quota=True,user_id='f3e01f15c0894f56bc2fa9611cb36f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Creating volume c0642346-f5ac-4624-bb8d-7fdffbb1030c {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:26 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:25:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:26 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c 1073741824 Jun 19 04:25:26 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:27 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-dfb03126-fdaa-4574-a2d8-bc3996310852 req-89d41cb3-a810-4731-a68a-08b1c1bdf177 tempest-TestInstancesWithCinderVolumes-921932341 None] Terminate volume connection completed successfully. Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-dfb03126-fdaa-4574-a2d8-bc3996310852 req-89d41cb3-a810-4731-a68a-08b1c1bdf177 tempest-TestInstancesWithCinderVolumes-921932341 None] Deleting attachment 0efd2b73-e65c-451b-89db-a504bf50fdc0. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:25:27 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.857s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:27 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Deleted volume successfully. Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e1f799c5-6bad-4092-8eef-04ce30f94008 tempest-VolumesTransfersV357Test-216586530 None] Lock "cinder-8f81d967-7934-44de-9f4e-4f1b1de69dce-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Flow 'volume_create_manager' (a5cd06af-935a-4b94-aa17-7d9ffbf8a6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376e3b90-df22-45da-8284-892444379381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376e3b90-df22-45da-8284-892444379381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-721945882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f514baed-1a65-481a-a9ed-2e3e3538e355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb24480a4e044fbc8ff7218580dcd11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:28Z,use_quota=True,user_id='1d9e7516a47e4a84962c32b38107208d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2cd82f-c460-45dc-824f-3d9f1bf8c8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2cd82f-c460-45dc-824f-3d9f1bf8c8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea22b07-e5c8-4b18-9a80-a0b9c190aca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea22b07-e5c8-4b18-9a80-a0b9c190aca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f514baed-1a65-481a-a9ed-2e3e3538e355', 'volume_name': 'volume-f514baed-1a65-481a-a9ed-2e3e3538e355', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40f8c55-346a-4b25-95bb-eb56affe6082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40f8c55-346a-4b25-95bb-eb56affe6082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3f0c02-209b-4dce-9bdc-5bad42c39824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:27 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Volume f514baed-1a65-481a-a9ed-2e3e3538e355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f514baed-1a65-481a-a9ed-2e3e3538e355', 'volume_size': 1} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "cinder-d8e4a17e-0b10-4e0a-bbbb-4a732b66447c-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-d8e4a17e-0b10-4e0a-bbbb-4a732b66447c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "cinder-quobyte-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "cinder-quobyte-d8e4a17e-0b10-4e0a-bbbb-4a732b66447c" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-d8e4a17e-0b10-4e0a-bbbb-4a732b66447c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Deleting offline snapshot d8e4a17e-0b10-4e0a-bbbb-4a732b66447c of volume 0d13ff3f-0bde-44f0-8139-3f6f60f549e3 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] snapshot_file for this snap is: volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb2ded3-eb4c-4296-a8b4-87d1775c9f56]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:28 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c 1073741824" returned: 0 in 1.131s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:28 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c Jun 19 04:25:28 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:28 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c Jun 19 04:25:28 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:28 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c" returned: 0 in 0.643s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-721945882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f514baed-1a65-481a-a9ed-2e3e3538e355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb24480a4e044fbc8ff7218580dcd11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:28Z,use_quota=True,user_id='1d9e7516a47e4a84962c32b38107208d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Creating volume f514baed-1a65-481a-a9ed-2e3e3538e355 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:28 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:28 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f514baed-1a65-481a-a9ed-2e3e3538e355 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c" returned: 0 in 0.782s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:25:28 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f514baed-1a65-481a-a9ed-2e3e3538e355 1073741824 Jun 19 04:25:28 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d969467-98a5-4742-8501-9fde611dbf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11e6591-d998-42ce-a430-10270838e34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f0334d-e0e1-48cb-bc44-c170b538e113]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:28 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Volume volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c (c0642346-f5ac-4624-bb8d-7fdffbb1030c): created successfully Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11e6591-d998-42ce-a430-10270838e34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Flow 'volume_create_manager' (675ed212-a3a9-4315-90cf-750c4c64699a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:28 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-70c52bc2-af19-4a85-a42e-ac04e773bc62 tempest-VolumesListTestJSON-467513100 None] Created volume successfully. Jun 19 04:25:28 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e Jun 19 04:25:28 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:28 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "cinder-055696c1-263f-4496-85e2-6b7e55b34d0d-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "cinder-055696c1-263f-4496-85e2-6b7e55b34d0d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "cinder-quobyte-055696c1-263f-4496-85e2-6b7e55b34d0d" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "cinder-quobyte-055696c1-263f-4496-85e2-6b7e55b34d0d" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:29 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec0e877-198a-4f81-bb26-ff373eb643b2]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:29 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d Jun 19 04:25:29 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:29 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f514baed-1a65-481a-a9ed-2e3e3538e355 1073741824" returned: 0 in 0.950s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f514baed-1a65-481a-a9ed-2e3e3538e355 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:29 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e" returned: 0 in 0.932s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:29 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:25:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:29 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f514baed-1a65-481a-a9ed-2e3e3538e355 Jun 19 04:25:29 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:29 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c Jun 19 04:25:29 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:30 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d" returned: 0 in 0.946s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:30 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d Jun 19 04:25:30 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:30 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f514baed-1a65-481a-a9ed-2e3e3538e355" returned: 0 in 0.782s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3f0c02-209b-4dce-9bdc-5bad42c39824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f514baed-1a65-481a-a9ed-2e3e3538e355', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda1046b-e75c-44d2-ae25-03e95499c557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:30 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Volume volume-f514baed-1a65-481a-a9ed-2e3e3538e355 (f514baed-1a65-481a-a9ed-2e3e3538e355): created successfully Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda1046b-e75c-44d2-ae25-03e95499c557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Flow 'volume_create_manager' (a5cd06af-935a-4b94-aa17-7d9ffbf8a6af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:30 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ab4074dd-e98e-42cd-982d-314237323a4d tempest-VolumesTransfersV357Test-1494041048 None] Created volume successfully. Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=130,cinder:UPDATE=123,cinder:INSERT=42,cinder:DELETE=9 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=116,cinder:UPDATE=143,cinder:DELETE=16,cinder:INSERT=32 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Flow 'volume_create_manager' (c2f2ca61-46d5-47a6-8872-307364331a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b25bf8ee-94c6-4af3-bf4b-870caad42bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b25bf8ee-94c6-4af3-bf4b-870caad42bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-966240263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f5b6df-bcff-4db1-b0d0-5537d3a80c29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14d8331302634fceb460eb6c8d6f9c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:31Z,use_quota=True,user_id='f3e01f15c0894f56bc2fa9611cb36f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f9cdcc-2159-4f28-a20c-8d5ca66aa432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f9cdcc-2159-4f28-a20c-8d5ca66aa432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f813ad-0037-4bbf-ab34-1d514c6ccd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f813ad-0037-4bbf-ab34-1d514c6ccd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f5b6df-bcff-4db1-b0d0-5537d3a80c29', 'volume_name': 'volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e9e3c1-7ca8-4ffb-8949-b14091c4770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e9e3c1-7ca8-4ffb-8949-b14091c4770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace09395-6e76-4437-b01e-7ad58d4d5d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:30 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Volume 37f5b6df-bcff-4db1-b0d0-5537d3a80c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29', 'volume_size': 1} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-966240263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f5b6df-bcff-4db1-b0d0-5537d3a80c29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14d8331302634fceb460eb6c8d6f9c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:31Z,use_quota=True,user_id='f3e01f15c0894f56bc2fa9611cb36f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Creating volume 37f5b6df-bcff-4db1-b0d0-5537d3a80c29 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:30 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:25:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:31 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29 1073741824 Jun 19 04:25:31 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:31 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c" returned: 0 in 1.398s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:31 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-055696c1-263f-4496-85e2-6b7e55b34d0d" returned: 0 in 1.072s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "cinder-quobyte-055696c1-263f-4496-85e2-6b7e55b34d0d" released by "delete_volume" :: held 2.085s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:31 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c Jun 19 04:25:31 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:31 devstack cinder-volume[93300]: WARNING cinder.quota [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1217834456-1887332683 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1217834456-1887332683, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:25:31 devstack cinder-volume[93300]: WARNING cinder.quota [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1217834456-1887332683 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1217834456-1887332683, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Created reservations ['94cab4d7-900d-47e2-a66c-1d5ac97388d0', '3e1ff060-6811-411a-bf99-233dd1fe62d1', '84639090-8ed1-4a05-b4c5-78b096f7a059', '35925ff0-ae4e-4a1f-84b9-e6d07bea5711'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Acquiring lock "cinder-f514baed-1a65-481a-a9ed-2e3e3538e355-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Lock "cinder-f514baed-1a65-481a-a9ed-2e3e3538e355-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Acquiring lock "cinder-quobyte-f514baed-1a65-481a-a9ed-2e3e3538e355" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:31 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:31 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Lock "cinder-quobyte-f514baed-1a65-481a-a9ed-2e3e3538e355" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bc6561-ed33-44b2-b9d7-7643f39b6337]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f514baed-1a65-481a-a9ed-2e3e3538e355 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:31 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f514baed-1a65-481a-a9ed-2e3e3538e355 Jun 19 04:25:31 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:32 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.d8e4a17e-0b10-4e0a-bbbb-4a732b66447c" returned: 0 in 1.164s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-d8e4a17e-0b10-4e0a-bbbb-4a732b66447c" released by "_delete_snapshot" :: held 4.411s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" released by "delete_snapshot" :: held 4.444s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:32 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Created reservations ['1e5c0710-6a1f-4738-b1e1-cf3748acb448', '48a90f41-820f-431e-aa06-e26bc6b93323', '6ae1fce3-25a8-4e69-aa80-fc8ffb254086', '2cfd9443-702f-4a25-b2be-20fa2b56a7a0'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:32 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29 1073741824" returned: 0 in 1.571s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:32 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Delete snapshot completed successfully. Jun 19 04:25:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c2b171dc-d505-41f5-a7fb-30ea15ecf218 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-d8e4a17e-0b10-4e0a-bbbb-4a732b66447c-delete_snapshot" released by "delete_snapshot" :: held 4.808s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:32 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29 Jun 19 04:25:32 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:32 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.208s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:32 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:32 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Deleted volume successfully. Jun 19 04:25:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d4cc9fda-4f0b-4221-93b7-b6e295768245 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "cinder-055696c1-263f-4496-85e2-6b7e55b34d0d-delete_volume" released by "delete_volume" :: held 3.735s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:32 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f514baed-1a65-481a-a9ed-2e3e3538e355" returned: 0 in 1.321s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f514baed-1a65-481a-a9ed-2e3e3538e355 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:32 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f514baed-1a65-481a-a9ed-2e3e3538e355 Jun 19 04:25:32 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "cinder-ae0b30d5-5d48-43f0-bb2d-f623daba7a5e-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-ae0b30d5-5d48-43f0-bb2d-f623daba7a5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "cinder-quobyte-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "cinder-quobyte-ae0b30d5-5d48-43f0-bb2d-f623daba7a5e" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-ae0b30d5-5d48-43f0-bb2d-f623daba7a5e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Deleting offline snapshot ae0b30d5-5d48-43f0-bb2d-f623daba7a5e of volume 0d13ff3f-0bde-44f0-8139-3f6f60f549e3 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] snapshot_file for this snap is: volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e51a85d-46ec-45b2-8c7e-9f48820eee04]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:33 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29" returned: 0 in 0.737s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] <== create_volume: return (2407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.413s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:33 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e Jun 19 04:25:33 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace09395-6e76-4437-b01e-7ad58d4d5d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0cb9e8-5550-499e-a052-4c0638bdbd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:33 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Volume volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29 (37f5b6df-bcff-4db1-b0d0-5537d3a80c29): created successfully Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0cb9e8-5550-499e-a052-4c0638bdbd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Flow 'volume_create_manager' (c2f2ca61-46d5-47a6-8872-307364331a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:33 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4066652b-3539-4e9d-a401-8551e81f332c tempest-VolumesListTestJSON-467513100 None] Created volume successfully. Jun 19 04:25:33 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f514baed-1a65-481a-a9ed-2e3e3538e355" returned: 0 in 0.751s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Lock "cinder-quobyte-f514baed-1a65-481a-a9ed-2e3e3538e355" released by "delete_volume" :: held 2.130s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Created reservations ['5e1fc3cf-a7e4-446a-ad52-bf1d0303827b', '528d839c-d553-4e61-b23a-6c6b0c6b0a33', 'df7508f6-07e7-4886-aaca-2fa1e552099d', 'c986b405-f0e3-48a1-b0e9-da7b436ed90e'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:33 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:33 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:34 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e" returned: 0 in 1.057s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:25:34 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3343b2-13e0-46a2-b8ce-e3f3eee4da6f]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:34 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 Jun 19 04:25:34 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Flow 'volume_create_manager' (b000cede-1bf0-42d5-9504-4407f8412d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadd2ca7-8876-4739-8638-47d9cace6982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadd2ca7-8876-4739-8638-47d9cace6982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-159723890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16c2bd9-1661-4b37-b870-34de170510f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14d8331302634fceb460eb6c8d6f9c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:35Z,use_quota=True,user_id='f3e01f15c0894f56bc2fa9611cb36f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7627c9-81e9-4c6f-abca-03f6a186d4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7627c9-81e9-4c6f-abca-03f6a186d4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d4ee0b-395a-4d45-9e52-b3daf90d45b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:35 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d4ee0b-395a-4d45-9e52-b3daf90d45b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a16c2bd9-1661-4b37-b870-34de170510f1', 'volume_name': 'volume-a16c2bd9-1661-4b37-b870-34de170510f1', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61b4722-fae7-458d-a231-207de76268ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61b4722-fae7-458d-a231-207de76268ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c068d2e-a72d-4442-a99b-94908a9b1505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:35 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Volume a16c2bd9-1661-4b37-b870-34de170510f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a16c2bd9-1661-4b37-b870-34de170510f1', 'volume_size': 1} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-159723890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16c2bd9-1661-4b37-b870-34de170510f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14d8331302634fceb460eb6c8d6f9c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:35Z,use_quota=True,user_id='f3e01f15c0894f56bc2fa9611cb36f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Creating volume a16c2bd9-1661-4b37-b870-34de170510f1 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:35 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a16c2bd9-1661-4b37-b870-34de170510f1 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.376s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:35 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Deleted volume successfully. Jun 19 04:25:35 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a16c2bd9-1661-4b37-b870-34de170510f1 1073741824 Jun 19 04:25:35 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f0980fd7-e5fe-40ba-b101-87b3fd76bd97 tempest-VolumesTransfersV357Test-216586530 None] Lock "cinder-f514baed-1a65-481a-a9ed-2e3e3538e355-delete_volume" released by "delete_volume" :: held 3.835s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:35 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535" returned: 0 in 1.356s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:25:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:35 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e Jun 19 04:25:35 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:36 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a16c2bd9-1661-4b37-b870-34de170510f1 1073741824" returned: 0 in 1.071s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a16c2bd9-1661-4b37-b870-34de170510f1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:36 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a16c2bd9-1661-4b37-b870-34de170510f1 Jun 19 04:25:36 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:36 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e" returned: 0 in 1.064s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:36 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e Jun 19 04:25:36 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:37 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a16c2bd9-1661-4b37-b870-34de170510f1" returned: 0 in 0.803s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c068d2e-a72d-4442-a99b-94908a9b1505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a16c2bd9-1661-4b37-b870-34de170510f1', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f56ba3a-9c64-4fea-af29-51e05cf2df6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:37 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Volume volume-a16c2bd9-1661-4b37-b870-34de170510f1 (a16c2bd9-1661-4b37-b870-34de170510f1): created successfully Jun 19 04:25:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f56ba3a-9c64-4fea-af29-51e05cf2df6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Flow 'volume_create_manager' (b000cede-1bf0-42d5-9504-4407f8412d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:37 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-952e528e-f6b2-4e07-b275-47501b0e2bf9 tempest-VolumesListTestJSON-467513100 None] Created volume successfully. Jun 19 04:25:37 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-93b7714a-4dd4-4c71-b954-6ca0350aa869 req-d648e2e1-2c33-4543-9a38-7a660eff5bd8 tempest-TestInstancesWithCinderVolumes-921932341 None] Terminate volume connection completed successfully. Jun 19 04:25:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-93b7714a-4dd4-4c71-b954-6ca0350aa869 req-d648e2e1-2c33-4543-9a38-7a660eff5bd8 tempest-TestInstancesWithCinderVolumes-921932341 None] Deleting attachment 386abe36-b398-460e-abb5-401da9c30231. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:25:37 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.ae0b30d5-5d48-43f0-bb2d-f623daba7a5e" returned: 0 in 0.765s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:37 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-ae0b30d5-5d48-43f0-bb2d-f623daba7a5e" released by "_delete_snapshot" :: held 4.398s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:37 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" released by "delete_snapshot" :: held 4.429s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:37 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Created reservations ['fde47b7d-a313-4626-a105-96ac648b147a', 'f0902ca2-50d3-421a-b659-225891527c6f', 'c3254765-8d5c-492a-9eb7-c76467ff57a3', 'dd19f76a-01c1-43e5-986e-d496913dde43'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:37 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Delete snapshot completed successfully. Jun 19 04:25:37 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b6f836f7-8d40-4723-b308-fe0620eb9fb6 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-ae0b30d5-5d48-43f0-bb2d-f623daba7a5e-delete_snapshot" released by "delete_snapshot" :: held 4.616s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "cinder-594bc6c5-0832-4c1d-8c1f-63d78c788535-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-594bc6c5-0832-4c1d-8c1f-63d78c788535-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "cinder-quobyte-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "cinder-quobyte-594bc6c5-0832-4c1d-8c1f-63d78c788535" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-594bc6c5-0832-4c1d-8c1f-63d78c788535" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Deleting offline snapshot 594bc6c5-0832-4c1d-8c1f-63d78c788535 of volume 0d13ff3f-0bde-44f0-8139-3f6f60f549e3 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:25:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] snapshot_file for this snap is: volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:25:38 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec25f2d-9d0a-4420-a302-ea4ba3ad1ae2]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:38 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 Jun 19 04:25:38 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:39 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535" returned: 0 in 1.052s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:25:39 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a0cf1c-6969-4ddc-beb1-a875c6e28dba]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:39 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 Jun 19 04:25:39 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:40 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" returned: 0 in 0.891s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:40 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 Jun 19 04:25:40 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Acquiring lock "cinder-a16c2bd9-1661-4b37-b870-34de170510f1-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Lock "cinder-a16c2bd9-1661-4b37-b870-34de170510f1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Acquiring lock "cinder-quobyte-a16c2bd9-1661-4b37-b870-34de170510f1" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Lock "cinder-quobyte-a16c2bd9-1661-4b37-b870-34de170510f1" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "cinder-0ff87c49-0cad-4213-ba34-c1107b2e1909-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:40 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7181008b-1833-4d7e-a78b-e474e215e1f2]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a16c2bd9-1661-4b37-b870-34de170510f1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "cinder-0ff87c49-0cad-4213-ba34-c1107b2e1909-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "cinder-quobyte-0ff87c49-0cad-4213-ba34-c1107b2e1909" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "cinder-quobyte-0ff87c49-0cad-4213-ba34-c1107b2e1909" acquired by "delete_volume" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:41 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a16c2bd9-1661-4b37-b870-34de170510f1 Jun 19 04:25:41 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:41 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c8158b-b03a-414c-8c8b-1dacc06de0b8]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:41 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 Jun 19 04:25:41 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:41 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535" returned: 0 in 0.978s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:41 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535 Jun 19 04:25:41 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:42 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a16c2bd9-1661-4b37-b870-34de170510f1" returned: 0 in 1.083s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a16c2bd9-1661-4b37-b870-34de170510f1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:42 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a16c2bd9-1661-4b37-b870-34de170510f1 Jun 19 04:25:42 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:42 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909" returned: 0 in 0.970s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (aa50d549-4524-48b3-89e1-539b03396ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:42 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 Jun 19 04:25:42 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5253f48-7d8c-4997-899d-f0b4dd50a781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5253f48-7d8c-4997-899d-f0b4dd50a781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1575493867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ff8e72-0263-4946-bc26-97a19e778e46,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1938e12aa3e94edf9496bcca01e09cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:42Z,use_quota=True,user_id='43aafc21a9db4634a2fe835735c0dcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3488e9-621d-4419-bc44-2f051cbf6bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3488e9-621d-4419-bc44-2f051cbf6bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fcc620-1066-4440-a751-b48cc0a0ca38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fcc620-1066-4440-a751-b48cc0a0ca38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ff8e72-0263-4946-bc26-97a19e778e46', 'volume_name': 'volume-b1ff8e72-0263-4946-bc26-97a19e778e46', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9503770a-1c60-4515-8279-9d8bc8199094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9503770a-1c60-4515-8279-9d8bc8199094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa68d4ab-9d12-469e-ac28-5d3d3816a773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:42 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Volume b1ff8e72-0263-4946-bc26-97a19e778e46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ff8e72-0263-4946-bc26-97a19e778e46', 'volume_size': 1} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1575493867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ff8e72-0263-4946-bc26-97a19e778e46,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1938e12aa3e94edf9496bcca01e09cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:42Z,use_quota=True,user_id='43aafc21a9db4634a2fe835735c0dcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Creating volume b1ff8e72-0263-4946-bc26-97a19e778e46 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:42 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b1ff8e72-0263-4946-bc26-97a19e778e46 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:42 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b1ff8e72-0263-4946-bc26-97a19e778e46 1073741824 Jun 19 04:25:42 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:42 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3.594bc6c5-0832-4c1d-8c1f-63d78c788535" returned: 0 in 0.780s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-594bc6c5-0832-4c1d-8c1f-63d78c788535" released by "_delete_snapshot" :: held 3.862s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" released by "delete_snapshot" :: held 3.893s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Created reservations ['b43ddef6-68f8-414e-85d8-d54293c7d024', '0cb3dd28-daf5-4f5c-b4f9-5e17b72b52f0', '487461ae-798f-4e60-880b-81b619b80a17', 'f7de0236-09fb-44b0-bbbd-630a3874dcb2'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:42 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Delete snapshot completed successfully. Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c1dc8744-80e0-45fe-90f0-bb58ac7b1063 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-594bc6c5-0832-4c1d-8c1f-63d78c788535-delete_snapshot" released by "delete_snapshot" :: held 4.088s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:42 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-a16c2bd9-1661-4b37-b870-34de170510f1" returned: 0 in 0.759s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Lock "cinder-quobyte-a16c2bd9-1661-4b37-b870-34de170510f1" released by "delete_volume" :: held 1.912s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Created reservations ['d9650844-f115-42a8-8723-f6b2d2932123', 'f5c1beaf-232c-4590-b41b-33ad35f9b74e', '9cff8493-39ab-4ca4-a310-1c9bddbacab3', '87b443a2-9255-437d-a7e1-88ae0bdcb464'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "cinder-0d13ff3f-0bde-44f0-8139-3f6f60f549e3-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-0d13ff3f-0bde-44f0-8139-3f6f60f549e3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:43 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909" returned: 1 in 0.924s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:43 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:43 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "cinder-quobyte-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:43 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909 Jun 19 04:25:43 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" acquired by "delete_volume" :: waited 0.042s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Acquiring lock "cinder-37f5b6df-bcff-4db1-b0d0-5537d3a80c29-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff78000-22bf-4fac-99a3-d68e52d2d20b]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Lock "cinder-37f5b6df-bcff-4db1-b0d0-5537d3a80c29-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Acquiring lock "cinder-quobyte-37f5b6df-bcff-4db1-b0d0-5537d3a80c29" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Lock "cinder-quobyte-37f5b6df-bcff-4db1-b0d0-5537d3a80c29" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e50cd12-126a-4812-a67a-5b5abd541b86]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:43 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 Jun 19 04:25:43 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:43 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b1ff8e72-0263-4946-bc26-97a19e778e46 1073741824" returned: 0 in 1.115s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b1ff8e72-0263-4946-bc26-97a19e778e46 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:43 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29 Jun 19 04:25:43 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:43 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b1ff8e72-0263-4946-bc26-97a19e778e46 Jun 19 04:25:43 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:43 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0ff87c49-0cad-4213-ba34-c1107b2e1909" returned: 0 in 0.844s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "cinder-quobyte-0ff87c49-0cad-4213-ba34-c1107b2e1909" released by "delete_volume" :: held 2.843s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:43 devstack cinder-volume[93300]: WARNING cinder.quota [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-810839291-1249365089 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-810839291-1249365089, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:25:43 devstack cinder-volume[93300]: WARNING cinder.quota [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-810839291-1249365089 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-810839291-1249365089, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Created reservations ['e77e7817-5cbd-47e6-b3a6-700d7795a0f3', '7ac0ba4c-e1b3-4cfe-9ca3-e4903b664cb4', '22a22ae3-14c7-4046-971a-7a7d54350520', '72444d96-e7ee-405b-8d3c-31b7bc7a06bb'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:44 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.066s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:44 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Deleted volume successfully. Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2ff585f3-78e6-45f0-af5f-328e4fe9fabd tempest-VolumesListTestJSON-467513100 None] Lock "cinder-a16c2bd9-1661-4b37-b870-34de170510f1-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:44 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:44 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:44 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" returned: 0 in 1.138s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:44 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b1ff8e72-0263-4946-bc26-97a19e778e46" returned: 0 in 0.879s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:44 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3 Jun 19 04:25:44 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa68d4ab-9d12-469e-ac28-5d3d3816a773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ff8e72-0263-4946-bc26-97a19e778e46', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b896cc-ae66-4686-b5c4-fee27404917e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:44 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Volume volume-b1ff8e72-0263-4946-bc26-97a19e778e46 (b1ff8e72-0263-4946-bc26-97a19e778e46): created successfully Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b896cc-ae66-4686-b5c4-fee27404917e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (aa50d549-4524-48b3-89e1-539b03396ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:44 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-791a1759-fd8d-4b75-beee-4dc2cb4920e4 tempest-VolumesGetTest-1051702476 None] Created volume successfully. Jun 19 04:25:44 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29" returned: 0 in 1.213s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:44 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29 Jun 19 04:25:44 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:45 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.874s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:45 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Deleted volume successfully. Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c42da3f3-7702-4533-865e-5233836cb157 tempest-TestInstancesWithCinderVolumes-921932341 None] Lock "cinder-0ff87c49-0cad-4213-ba34-c1107b2e1909-delete_volume" released by "delete_volume" :: held 4.067s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:45 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" returned: 0 in 0.876s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-quobyte-0d13ff3f-0bde-44f0-8139-3f6f60f549e3" released by "delete_volume" :: held 2.117s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Created reservations ['cd496f13-d27e-4c4f-b08b-3f73909526d2', 'd3b81e1c-d553-4983-9c37-9ae859790d70', 'f7d3ef06-c367-4e62-80a8-fd15c9ecdf13', 'd847cb63-6083-44cf-bd83-95b5b9e3a24d'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:45 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-37f5b6df-bcff-4db1-b0d0-5537d3a80c29" returned: 0 in 0.804s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Lock "cinder-quobyte-37f5b6df-bcff-4db1-b0d0-5537d3a80c29" released by "delete_volume" :: held 2.103s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:45 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:45 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Created reservations ['8b24ef73-3c4b-4270-a14b-69e1493eba8a', '86aab1d3-cf18-49dc-a8b4-92a0063dc776', '4b1d463d-0757-4af7-8cb2-d3804bbed32f', '5bfb771c-5953-41f2-86d0-704351249864'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:45 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:45 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.777s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:46 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:46 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Deleted volume successfully. Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-674ead78-3eeb-48a8-a09d-99e34227b590 tempest-VolumesSnapshotListTestJSON-311886685 None] Lock "cinder-0d13ff3f-0bde-44f0-8139-3f6f60f549e3-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (a4af594f-9f18-4eff-ac36-172a00569477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:46 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5d2b86-a8e6-45de-b1dc-55362e401f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.879s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:46 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Deleted volume successfully. Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5d2b86-a8e6-45de-b1dc-55362e401f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1846135799',display_name='tempest-VolumesGetTest-Volume-2058572749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b711521-583a-4350-a1a7-d8975705a0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1938e12aa3e94edf9496bcca01e09cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:46Z,use_quota=True,user_id='43aafc21a9db4634a2fe835735c0dcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2995ba32-bdfd-4def-a384-b07eba856729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2995ba32-bdfd-4def-a384-b07eba856729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e0c5c2-a276-403f-90ba-75adc38ea3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e0c5c2-a276-403f-90ba-75adc38ea3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b711521-583a-4350-a1a7-d8975705a0a2', 'volume_name': 'volume-6b711521-583a-4350-a1a7-d8975705a0a2', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0d10ae-1e82-4026-a000-49aa99829dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0d10ae-1e82-4026-a000-49aa99829dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc141f65-3141-4d0b-9d26-02c599a33281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:46 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Volume 6b711521-583a-4350-a1a7-d8975705a0a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b711521-583a-4350-a1a7-d8975705a0a2', 'volume_size': 1} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1846135799',display_name='tempest-VolumesGetTest-Volume-2058572749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b711521-583a-4350-a1a7-d8975705a0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1938e12aa3e94edf9496bcca01e09cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:46Z,use_quota=True,user_id='43aafc21a9db4634a2fe835735c0dcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Creating volume 6b711521-583a-4350-a1a7-d8975705a0a2 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:46 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6b711521-583a-4350-a1a7-d8975705a0a2 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-25ab26ef-bf3d-4754-b4ed-3da9162990b4 tempest-VolumesListTestJSON-467513100 None] Lock "cinder-37f5b6df-bcff-4db1-b0d0-5537d3a80c29-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:46 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6b711521-583a-4350-a1a7-d8975705a0a2 1073741824 Jun 19 04:25:46 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Acquiring lock "cinder-c0642346-f5ac-4624-bb8d-7fdffbb1030c-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Lock "cinder-c0642346-f5ac-4624-bb8d-7fdffbb1030c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Acquiring lock "cinder-quobyte-c0642346-f5ac-4624-bb8d-7fdffbb1030c" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Lock "cinder-quobyte-c0642346-f5ac-4624-bb8d-7fdffbb1030c" acquired by "delete_volume" :: waited 0.032s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f10577-16c0-48fb-b240-b8bf2159b442]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:47 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c Jun 19 04:25:47 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:47 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6b711521-583a-4350-a1a7-d8975705a0a2 1073741824" returned: 0 in 1.151s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6b711521-583a-4350-a1a7-d8975705a0a2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:47 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6b711521-583a-4350-a1a7-d8975705a0a2 Jun 19 04:25:47 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:47 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c" returned: 0 in 0.943s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:47 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c Jun 19 04:25:47 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:48 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6b711521-583a-4350-a1a7-d8975705a0a2" returned: 0 in 0.903s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc141f65-3141-4d0b-9d26-02c599a33281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b711521-583a-4350-a1a7-d8975705a0a2', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d55790-b6d0-4b3d-a0c3-a135421a1509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:48 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Volume volume-6b711521-583a-4350-a1a7-d8975705a0a2 (6b711521-583a-4350-a1a7-d8975705a0a2): created successfully Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d55790-b6d0-4b3d-a0c3-a135421a1509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (a4af594f-9f18-4eff-ac36-172a00569477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:48 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c0642346-f5ac-4624-bb8d-7fdffbb1030c" returned: 0 in 0.880s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:48 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f4d8ee85-d502-498e-9cd4-907330cc00bd tempest-VolumesGetTest-1051702476 None] Created volume successfully. Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Lock "cinder-quobyte-c0642346-f5ac-4624-bb8d-7fdffbb1030c" released by "delete_volume" :: held 1.892s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Created reservations ['b8c41161-849a-40c7-94b8-c8559526b1a4', '2e6a7366-f75a-4561-b044-49f31f3a0126', 'a955bdfd-af4c-4f33-b361-6b3cba54648a', 'ac708314-c863-4cfa-b890-da8e44fc4fb1'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:49 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:49 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:49 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.804s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:49 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:49 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Deleted volume successfully. Jun 19 04:25:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-6b711521-583a-4350-a1a7-d8975705a0a2-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-d29e331d-6e0e-4aed-bdfd-7330a15d3a02 tempest-VolumesListTestJSON-467513100 None] Lock "cinder-c0642346-f5ac-4624-bb8d-7fdffbb1030c-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Lock "cinder-6b711521-583a-4350-a1a7-d8975705a0a2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-quobyte-6b711521-583a-4350-a1a7-d8975705a0a2" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-6b711521-583a-4350-a1a7-d8975705a0a2" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:49 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0130932-607d-405a-b172-64a5df46e9f6]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6b711521-583a-4350-a1a7-d8975705a0a2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:50 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6b711521-583a-4350-a1a7-d8975705a0a2 Jun 19 04:25:50 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:50 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6b711521-583a-4350-a1a7-d8975705a0a2" returned: 0 in 0.897s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6b711521-583a-4350-a1a7-d8975705a0a2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:50 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6b711521-583a-4350-a1a7-d8975705a0a2 Jun 19 04:25:50 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:51 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-6b711521-583a-4350-a1a7-d8975705a0a2" returned: 0 in 0.747s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-6b711521-583a-4350-a1a7-d8975705a0a2" released by "delete_volume" :: held 1.703s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:51 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Created reservations ['3b7d6338-94de-4a21-807b-26f7b9decbe9', 'dde34bbd-c99a-4e0c-88b0-633c41b53208', 'eb06b0c1-d0f7-4a30-aa83-f9b69e35070c', 'f55597dc-2ca0-41cb-bffb-e376664ff43e'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:51 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:51 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-b1ff8e72-0263-4946-bc26-97a19e778e46-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Lock "cinder-b1ff8e72-0263-4946-bc26-97a19e778e46-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-quobyte-b1ff8e72-0263-4946-bc26-97a19e778e46" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-b1ff8e72-0263-4946-bc26-97a19e778e46" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:52 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e1d16a-3f14-4faf-a241-27cc66a58612]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b1ff8e72-0263-4946-bc26-97a19e778e46 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:52 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b1ff8e72-0263-4946-bc26-97a19e778e46 Jun 19 04:25:52 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:53 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.150s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:53 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:53 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Deleted volume successfully. Jun 19 04:25:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c53cc630-c2a4-44cc-b3f4-de526101efba tempest-VolumesGetTest-1051702476 None] Lock "cinder-6b711521-583a-4350-a1a7-d8975705a0a2-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:53 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b1ff8e72-0263-4946-bc26-97a19e778e46" returned: 0 in 1.192s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b1ff8e72-0263-4946-bc26-97a19e778e46 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:53 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b1ff8e72-0263-4946-bc26-97a19e778e46 Jun 19 04:25:53 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Flow 'volume_create_manager' (cbd9775d-1205-4a9f-8d0e-ed6358635d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f3ef52-27a9-4bde-b557-34f153cd16ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f3ef52-27a9-4bde-b557-34f153cd16ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-675230787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14946724-1e21-4e9b-bfbb-a450beb51961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ec2c4e2d004dfb9bc812a65fa3015b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:54Z,use_quota=True,user_id='c46dba2c292f45edb00d52c89294278f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1f33c3-d975-4b28-b304-69f48bd27449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1f33c3-d975-4b28-b304-69f48bd27449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8aef374-6b33-4e79-8893-2edcdfa80469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8aef374-6b33-4e79-8893-2edcdfa80469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14946724-1e21-4e9b-bfbb-a450beb51961', 'volume_name': 'volume-14946724-1e21-4e9b-bfbb-a450beb51961', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faddaa42-8d6f-47ad-a2e4-16cb0c268ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faddaa42-8d6f-47ad-a2e4-16cb0c268ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0003c890-38ca-4057-9d1f-1f372ec12f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:54 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Volume 14946724-1e21-4e9b-bfbb-a450beb51961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14946724-1e21-4e9b-bfbb-a450beb51961', 'volume_size': 1} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-675230787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14946724-1e21-4e9b-bfbb-a450beb51961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ec2c4e2d004dfb9bc812a65fa3015b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:54Z,use_quota=True,user_id='c46dba2c292f45edb00d52c89294278f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Creating volume 14946724-1e21-4e9b-bfbb-a450beb51961 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:54 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-14946724-1e21-4e9b-bfbb-a450beb51961 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:54 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-14946724-1e21-4e9b-bfbb-a450beb51961 1073741824 Jun 19 04:25:54 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:54 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b1ff8e72-0263-4946-bc26-97a19e778e46" returned: 0 in 0.801s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-b1ff8e72-0263-4946-bc26-97a19e778e46" released by "delete_volume" :: held 2.060s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Created reservations ['7e4ab4a2-ac62-41e6-9b98-c13c373c80a3', '841b9dff-0bbb-4fcb-8231-da09fb9b0556', '0fb0fb64-4caf-4649-aa34-a3a4293417b2', 'a90c2ac5-2ef8-420f-8f64-a86b65c79b80'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:54 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:25:54 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:55 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.792s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:55 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:55 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Deleted volume successfully. Jun 19 04:25:55 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-14946724-1e21-4e9b-bfbb-a450beb51961 1073741824" returned: 0 in 1.226s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-149b6c40-36f9-4fee-8c89-6ad244699a71 tempest-VolumesGetTest-1051702476 None] Lock "cinder-b1ff8e72-0263-4946-bc26-97a19e778e46-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-14946724-1e21-4e9b-bfbb-a450beb51961 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:55 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-14946724-1e21-4e9b-bfbb-a450beb51961 Jun 19 04:25:55 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:56 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-14946724-1e21-4e9b-bfbb-a450beb51961" returned: 0 in 0.916s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0003c890-38ca-4057-9d1f-1f372ec12f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14946724-1e21-4e9b-bfbb-a450beb51961', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f9746d-f1bd-494d-8b5b-f277e2f3ba56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (b707aeb9-0ec1-44c9-9287-2f7b2f2ac781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (821e3e20-3af9-4d8f-a351-544b9cdc8fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:56 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Volume volume-14946724-1e21-4e9b-bfbb-a450beb51961 (14946724-1e21-4e9b-bfbb-a450beb51961): created successfully Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f9746d-f1bd-494d-8b5b-f277e2f3ba56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Flow 'volume_create_manager' (cbd9775d-1205-4a9f-8d0e-ed6358635d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (821e3e20-3af9-4d8f-a351-544b9cdc8fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1662331701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8fb9737-31ed-48af-bf83-b5e6ee337af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1938e12aa3e94edf9496bcca01e09cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:57Z,use_quota=True,user_id='43aafc21a9db4634a2fe835735c0dcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efe77a4-ee32-40d7-9137-c93cd894b7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efe77a4-ee32-40d7-9137-c93cd894b7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f9789a-7af7-470f-9165-c37ff8286460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f9789a-7af7-470f-9165-c37ff8286460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8fb9737-31ed-48af-bf83-b5e6ee337af2', 'volume_name': 'volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1519714-ff7d-40a4-afc0-94b2e4e1220b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1519714-ff7d-40a4-afc0-94b2e4e1220b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929281df-5ffc-4be9-835e-7a1c7a9e0ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:56 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Volume d8fb9737-31ed-48af-bf83-b5e6ee337af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2', 'volume_size': 1} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1662331701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8fb9737-31ed-48af-bf83-b5e6ee337af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1938e12aa3e94edf9496bcca01e09cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:57Z,use_quota=True,user_id='43aafc21a9db4634a2fe835735c0dcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Creating volume d8fb9737-31ed-48af-bf83-b5e6ee337af2 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:56 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:25:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:56 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-309ad5a4-4312-4e1a-b25f-0f27560348bb tempest-VolumesNegativeTest-1588633875 None] Created volume successfully. Jun 19 04:25:56 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 1073741824 Jun 19 04:25:56 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:58 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 1073741824" returned: 0 in 1.168s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:58 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 Jun 19 04:25:58 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:59 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2" returned: 0 in 0.950s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.176s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929281df-5ffc-4be9-835e-7a1c7a9e0ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8167fab5-5fed-4841-ae09-ea9baf881313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:59 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Volume volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 (d8fb9737-31ed-48af-bf83-b5e6ee337af2): created successfully Jun 19 04:25:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8167fab5-5fed-4841-ae09-ea9baf881313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (b707aeb9-0ec1-44c9-9287-2f7b2f2ac781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:59 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e793ec68-5a59-4e29-8af0-4379ce95fba3 tempest-VolumesGetTest-1051702476 None] Created volume successfully. Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (c0911158-458c-4ac7-96fe-02c3606f7b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2ad3c3-39b4-4979-9ca6-c5587fc13f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2ad3c3-39b4-4979-9ca6-c5587fc13f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-460298111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d85470c-fb3e-4bb3-b78e-d20eb13c026f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1938e12aa3e94edf9496bcca01e09cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d8fb9737-31ed-48af-bf83-b5e6ee337af2,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:01Z,use_quota=True,user_id='43aafc21a9db4634a2fe835735c0dcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5ef0a2-856c-4db1-a253-c2784c334386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5ef0a2-856c-4db1-a253-c2784c334386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b644e41-1202-4555-9b17-2e9fea73cddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b644e41-1202-4555-9b17-2e9fea73cddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5d85470c-fb3e-4bb3-b78e-d20eb13c026f', 'volume_name': 'volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f', 'volume_size': 1, 'source_volid': 'd8fb9737-31ed-48af-bf83-b5e6ee337af2', 'source_volstatus': 'available'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ce3c16-2519-495a-8de9-9dc74309f177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ce3c16-2519-495a-8de9-9dc74309f177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1359818-7586-479d-8e7c-965d81e6adae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:00 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Volume 5d85470c-fb3e-4bb3-b78e-d20eb13c026f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f', 'volume_size': 1, 'source_volid': 'd8fb9737-31ed-48af-bf83-b5e6ee337af2', 'source_volstatus': 'available'} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:00 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Cloning volume d8fb9737-31ed-48af-bf83-b5e6ee337af2 to volume 5d85470c-fb3e-4bb3-b78e-d20eb13c026f Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Creating offline snapshot 322ac438-2c9d-4435-9511-4ec1b122394d of volume d8fb9737-31ed-48af-bf83-b5e6ee337af2 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[992a3435-0d80-405f-a60a-67cdf8d742d4]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:00 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 Jun 19 04:26:00 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:01 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2" returned: 0 in 0.911s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:01 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d 1G Jun 19 04:26:01 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:02 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d 1G" returned: 0 in 1.137s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:02 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d Jun 19 04:26:02 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:03 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d" returned: 0 in 0.878s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:03 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d is being set with open permissions: ugo+rw Jun 19 04:26:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:03 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d Jun 19 04:26:03 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d" returned: 0 in 0.908s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:04 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:04 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.info Jun 19 04:26:04 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:05 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.info" returned: 0 in 0.754s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:05 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.info is being set with open permissions: ugo+rw Jun 19 04:26:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:05 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.info Jun 19 04:26:05 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:06 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.info" returned: 0 in 0.887s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-quobyte-5d85470c-fb3e-4bb3-b78e-d20eb13c026f" by "_copy_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-5d85470c-fb3e-4bb3-b78e-d20eb13c026f" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] snapshot: 322ac438-2c9d-4435-9511-4ec1b122394d, volume: 5d85470c-fb3e-4bb3-b78e-d20eb13c026f, {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:26:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:06 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4592b5d-d774-4ab5-b01e-4231258ff0f1]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:06 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d Jun 19 04:26:06 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:07 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d" returned: 0 in 0.870s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:26:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:26:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Creating direct copy from snapshot {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:26:07 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ac7203-4476-49cb-8227-2b4b8faa58ed]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:07 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 Jun 19 04:26:07 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:08 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2" returned: 0 in 0.987s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:08 devstack cinder-volume[93300]: DEBUG cinder.utils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Path /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f not found in is_blk_device check {{(pid=93300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:26:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:08 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f Jun 19 04:26:08 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:14 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f" returned: 0 in 6.212s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:14 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2a763e-4738-476e-8003-081ed2cebcdb]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:14 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 Jun 19 04:26:14 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:14 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=69,cinder:INSERT=26,cinder:UPDATE=103,cinder:DELETE=8 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:26:14 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=81,cinder:INSERT=30,cinder:UPDATE=110,cinder:DELETE=7 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:26:15 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2" returned: 0 in 1.029s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:15 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:26:15 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Converted 1024.00 MB image at 164.79 MB/s Jun 19 04:26:15 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f is being set with open permissions: ugo+rw Jun 19 04:26:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:15 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f Jun 19 04:26:15 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:16 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f" returned: 0 in 0.720s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-5d85470c-fb3e-4bb3-b78e-d20eb13c026f" released by "_copy_volume_from_snapshot" :: held 9.928s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-quobyte-322ac438-2c9d-4435-9511-4ec1b122394d" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-322ac438-2c9d-4435-9511-4ec1b122394d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Deleting offline snapshot 322ac438-2c9d-4435-9511-4ec1b122394d of volume d8fb9737-31ed-48af-bf83-b5e6ee337af2 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:26:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] snapshot_file for this snap is: volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:26:16 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[73af3233-cf9c-4da8-b863-0e8986402cd9]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:16 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d Jun 19 04:26:16 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:17 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d" returned: 0 in 0.971s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:26:17 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a4d67e-187c-4eab-987e-698e48eb8bbf]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:17 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 Jun 19 04:26:17 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:18 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2" returned: 0 in 0.918s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:18 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d Jun 19 04:26:18 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:26:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:19 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:26:19 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:19 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d" returned: 0 in 0.887s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:19 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d Jun 19 04:26:19 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:20 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.904s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:20 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:26:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 29 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:26:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:26:20 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2.322ac438-2c9d-4435-9511-4ec1b122394d" returned: 0 in 1.040s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-322ac438-2c9d-4435-9511-4ec1b122394d" released by "_delete_snapshot" :: held 3.955s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.643s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1359818-7586-479d-8e7c-965d81e6adae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f', 'volume_size': 1, 'source_volid': 'd8fb9737-31ed-48af-bf83-b5e6ee337af2', 'source_volstatus': 'available'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e7d5cc-723e-4f57-ae65-01412c16a62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:20 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Volume volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f (5d85470c-fb3e-4bb3-b78e-d20eb13c026f): created successfully Jun 19 04:26:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e7d5cc-723e-4f57-ae65-01412c16a62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (c0911158-458c-4ac7-96fe-02c3606f7b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:20 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-6d61983c-d3d4-4cf4-b262-171437808fb5 tempest-VolumesGetTest-1051702476 None] Created volume successfully. Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (39644808-c91a-41a0-af0b-dfa0554fae60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1069b077-7e7f-4ff5-bd4c-250f1f3b78d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1069b077-7e7f-4ff5-bd4c-250f1f3b78d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-615292954',display_name='tempest-VolumesGetTest-Volume-602273389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed6ae72-f9d0-4770-b7eb-acf7fb72a42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1938e12aa3e94edf9496bcca01e09cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:22Z,use_quota=True,user_id='43aafc21a9db4634a2fe835735c0dcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88898c5-10d9-499a-885f-3330cc83888e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88898c5-10d9-499a-885f-3330cc83888e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b9a3e0-c0f3-4b23-9e0d-e1424f5ace9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b9a3e0-c0f3-4b23-9e0d-e1424f5ace9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed6ae72-f9d0-4770-b7eb-acf7fb72a42c', 'volume_name': 'volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da89854a-2da9-41a5-9b34-9b2411a5654b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da89854a-2da9-41a5-9b34-9b2411a5654b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4095efd1-1cb4-4f02-84ca-88d32dd9cfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:22 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Volume bed6ae72-f9d0-4770-b7eb-acf7fb72a42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c', 'volume_size': 1} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-615292954',display_name='tempest-VolumesGetTest-Volume-602273389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed6ae72-f9d0-4770-b7eb-acf7fb72a42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1938e12aa3e94edf9496bcca01e09cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:22Z,use_quota=True,user_id='43aafc21a9db4634a2fe835735c0dcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Creating volume bed6ae72-f9d0-4770-b7eb-acf7fb72a42c {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:22 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:26:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:22 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c 1073741824 Jun 19 04:26:22 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:23 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c 1073741824" returned: 0 in 1.048s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:23 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c Jun 19 04:26:23 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:24 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c" returned: 0 in 0.732s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:24 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4095efd1-1cb4-4f02-84ca-88d32dd9cfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35558753-70eb-4635-82fb-31e10861e80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:24 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Volume volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c (bed6ae72-f9d0-4770-b7eb-acf7fb72a42c): created successfully Jun 19 04:26:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35558753-70eb-4635-82fb-31e10861e80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:24 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (39644808-c91a-41a0-af0b-dfa0554fae60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:24 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-6d3d1180-683a-43fa-8dea-3fc222128e5a tempest-VolumesGetTest-1051702476 None] Created volume successfully. Jun 19 04:26:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Lock "cinder-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-quobyte-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:24 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2da75ac-7923-4586-b36a-4d80809dc189]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:24 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c Jun 19 04:26:24 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:25 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c" returned: 0 in 0.966s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:25 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c Jun 19 04:26:25 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:26 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c" returned: 0 in 0.789s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:26 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c" released by "delete_volume" :: held 1.815s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:26 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Created reservations ['089f422a-efe3-4a5f-8d77-0c906ed8de14', 'cbb87d0b-702a-43fa-98b3-0a31a614e5a2', 'cadbf748-4a31-4495-8f08-7efaabf9832b', 'daa225ff-e266-4d11-96bc-5061efcfed8a'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:26 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:26:26 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-5d85470c-fb3e-4bb3-b78e-d20eb13c026f-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Lock "cinder-5d85470c-fb3e-4bb3-b78e-d20eb13c026f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-quobyte-5d85470c-fb3e-4bb3-b78e-d20eb13c026f" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-5d85470c-fb3e-4bb3-b78e-d20eb13c026f" acquired by "delete_volume" :: waited 0.024s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:27 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfad8760-be44-4915-bf09-ee27acbecf14]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:27 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f Jun 19 04:26:27 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:27 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.992s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:27 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:27 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Deleted volume successfully. Jun 19 04:26:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-838fccf7-02f2-4b01-928f-ce646b6535f1 tempest-VolumesGetTest-1051702476 None] Lock "cinder-bed6ae72-f9d0-4770-b7eb-acf7fb72a42c-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:28 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f" returned: 0 in 0.998s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:28 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f Jun 19 04:26:28 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:29 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d85470c-fb3e-4bb3-b78e-d20eb13c026f" returned: 0 in 0.783s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-5d85470c-fb3e-4bb3-b78e-d20eb13c026f" released by "delete_volume" :: held 1.835s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Created reservations ['8f22c50f-6b86-4500-9f1f-d95227867db4', 'cfbaba6f-a035-42e3-854a-b39fbe9c1b84', '1c229b6e-3072-4584-a42e-3201957a6868', '31bbbcb7-f1bb-4a97-86a3-e704b93518ea'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:29 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:26:29 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-d8fb9737-31ed-48af-bf83-b5e6ee337af2-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Lock "cinder-d8fb9737-31ed-48af-bf83-b5e6ee337af2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-quobyte-d8fb9737-31ed-48af-bf83-b5e6ee337af2" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-d8fb9737-31ed-48af-bf83-b5e6ee337af2" acquired by "delete_volume" :: waited 0.049s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f938490e-4653-465d-8a33-f2e9ac6b9a48]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:30 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 Jun 19 04:26:30 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:30 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.312s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:30 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:30 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Deleted volume successfully. Jun 19 04:26:30 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-82a5e1dc-8fa7-4ae8-9264-0837a531e616 tempest-VolumesGetTest-1051702476 None] Lock "cinder-5d85470c-fb3e-4bb3-b78e-d20eb13c026f-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:31 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2" returned: 0 in 1.720s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:31 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2 Jun 19 04:26:31 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:32 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d8fb9737-31ed-48af-bf83-b5e6ee337af2" returned: 0 in 1.243s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-d8fb9737-31ed-48af-bf83-b5e6ee337af2" released by "delete_volume" :: held 3.064s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:32 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Created reservations ['ccaf1247-3727-4f8a-98fe-035f059a3936', 'b1f87902-992f-4636-bb76-fbc9670624c8', 'd6c51e5e-eeb7-4982-a778-6a613053803b', '899699fa-2599-41f3-906f-d0ae3b0cdef0'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:33 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:26:33 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:34 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.611s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:34 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:34 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Deleted volume successfully. Jun 19 04:26:34 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-7a316b3c-9451-4820-a970-9ca1f13468e7 tempest-VolumesGetTest-1051702476 None] Lock "cinder-d8fb9737-31ed-48af-bf83-b5e6ee337af2-delete_volume" released by "delete_volume" :: held 5.273s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:35 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (485842b6-f3be-41b7-a6cd-014eb4fa1246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e04ebef-fbc3-442e-830f-1d7ae5144173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e04ebef-fbc3-442e-830f-1d7ae5144173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1572161312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1938e12aa3e94edf9496bcca01e09cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:35Z,use_quota=True,user_id='43aafc21a9db4634a2fe835735c0dcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be82e81-4277-4d6c-a660-d7ba476bb4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be82e81-4277-4d6c-a660-d7ba476bb4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9106844-989e-4d26-8ceb-b8f507974767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:35 devstack cinder-volume[93300]: DEBUG cinder.image.glance [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Creating Keystone auth plugin from conf {{(pid=93300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:26:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9106844-989e-4d26-8ceb-b8f507974767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6', 'volume_name': 'volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6', 'volume_size': 1, 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dffb3ac9be154db7807c947881bed470', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'created_at': datetime.datetime(2026, 6, 19, 2, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac128f6-16c9-45ff-89ac-7a938de35b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac128f6-16c9-45ff-89ac-7a938de35b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bf3aa3-9035-4480-8608-6abb0c08a930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:35 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Volume ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6', 'volume_size': 1, 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dffb3ac9be154db7807c947881bed470', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'created_at': datetime.datetime(2026, 6, 19, 2, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 19 04:26:35 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Trying to clone ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 from image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 at location (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]). {{(pid=93300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:26:36 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:26:36 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Image download 20.69 MB at 20.69 MB/s Jun 19 04:26:36 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[027315cb-0393-4801-bad4-b7742a8d15ee]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:36 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD Jun 19 04:26:36 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:37 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD" returned: 0 in 0.964s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:37 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Temporary image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 is fetched for user 43aafc21a9db4634a2fe835735c0dcad. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:26:37 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[60556a0a-e58b-4249-813a-d03566858c87]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:37 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD Jun 19 04:26:37 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:38 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD" returned: 0 in 0.989s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1572161312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1938e12aa3e94edf9496bcca01e09cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:35Z,use_quota=True,user_id='43aafc21a9db4634a2fe835735c0dcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Creating volume ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:38 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:38 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 1073741824 Jun 19 04:26:38 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Flow 'volume_create_manager' (03c1f63c-7ac0-4c9a-94e6-a0143564825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d363365-16e6-44e7-adcb-ff8a431e6e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d363365-16e6-44e7-adcb-ff8a431e6e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-633643993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1a52e6-dfc5-43df-a283-550d2a2e1acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b549c75321e4168951d6e57e0c74c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:38Z,use_quota=True,user_id='9c2dc51e28574ac79511299f91743cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040156f4-a68a-4ad3-ba07-eec27005270d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040156f4-a68a-4ad3-ba07-eec27005270d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9232c327-5675-4a8f-9177-cb22b10b1ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.image.glance [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Creating Keystone auth plugin from conf {{(pid=93300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9232c327-5675-4a8f-9177-cb22b10b1ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da1a52e6-dfc5-43df-a283-550d2a2e1acf', 'volume_name': 'volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf', 'volume_size': 1, 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dffb3ac9be154db7807c947881bed470', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'created_at': datetime.datetime(2026, 6, 19, 2, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f58cae-f9d0-476f-9282-87948a94e367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f58cae-f9d0-476f-9282-87948a94e367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a3ed5d-c0fe-4290-b965-b1f5940e5ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:38 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Volume da1a52e6-dfc5-43df-a283-550d2a2e1acf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf', 'volume_size': 1, 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dffb3ac9be154db7807c947881bed470', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'created_at': datetime.datetime(2026, 6, 19, 2, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 19 04:26:38 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Trying to clone da1a52e6-dfc5-43df-a283-550d2a2e1acf from image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 at location (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]). {{(pid=93300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:26:39 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:26:39 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Image download 20.69 MB at 20.69 MB/s Jun 19 04:26:39 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a063db5-e1e3-4a01-ba72-ac0a2c452c9f]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:39 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD Jun 19 04:26:39 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:39 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 1073741824" returned: 0 in 1.009s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:39 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 Jun 19 04:26:39 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:39 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD" returned: 0 in 0.801s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:39 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Temporary image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 is fetched for user 9c2dc51e28574ac79511299f91743cfa. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:26:40 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[09efc8ab-8aaf-4047-ba24-4e0efd964cb3]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:40 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD Jun 19 04:26:40 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:40 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6" returned: 0 in 0.720s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:40 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Attempting download of 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 ((None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}])) to volume ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:26:40 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[46addd75-230f-48e5-a6ec-077c07dd5e0d]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_qzz2us_o {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:40 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_qzz2us_o Jun 19 04:26:40 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:41 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD" returned: 0 in 1.131s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-633643993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1a52e6-dfc5-43df-a283-550d2a2e1acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b549c75321e4168951d6e57e0c74c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:38Z,use_quota=True,user_id='9c2dc51e28574ac79511299f91743cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Creating volume da1a52e6-dfc5-43df-a283-550d2a2e1acf {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:41 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:41 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf 1073741824 Jun 19 04:26:41 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:41 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_qzz2us_o" returned: 0 in 0.976s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_qzz2us_o {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:41 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_qzz2us_o Jun 19 04:26:41 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:42 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_qzz2us_o" returned: 1 in 0.879s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_qzz2us_o' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:26:42 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd385762-c8cb-4f71-a547-3dade98784f9]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:42 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD Jun 19 04:26:42 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:42 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf 1073741824" returned: 0 in 1.301s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:42 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf Jun 19 04:26:42 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:43 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD" returned: 0 in 1.004s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:43 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 was qcow2, converting to raw {{(pid=93300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:26:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:43 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 Jun 19 04:26:43 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:43 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf" returned: 0 in 0.713s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:43 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:43 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Attempting download of 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 ((None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}])) to volume da1a52e6-dfc5-43df-a283-550d2a2e1acf. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:26:43 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab6197b-778c-473c-82c2-2c6fc1929773]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_xjsjkz8b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:43 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_xjsjkz8b Jun 19 04:26:43 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:44 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_xjsjkz8b" returned: 0 in 0.821s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_xjsjkz8b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:44 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_xjsjkz8b Jun 19 04:26:44 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:45 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_xjsjkz8b" returned: 1 in 0.823s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_xjsjkz8b' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:26:45 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4009e47d-ae55-48a0-94e7-074fc036a8fd]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:45 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD Jun 19 04:26:45 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:45 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6" returned: 0 in 2.248s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:45 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_g9xlmf_tdevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:26:45 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Converted 112.00 MB image at 49.78 MB/s Jun 19 04:26:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:45 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 1G Jun 19 04:26:45 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:45 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD" returned: 0 in 0.853s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:45 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 was qcow2, converting to raw {{(pid=93300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:26:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:45 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf Jun 19 04:26:45 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:46 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 1G" returned: 0 in 0.752s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:46 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5891e9f-ae0f-455f-80e6-62708e3e0906]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:46 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 Jun 19 04:26:46 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:47 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6" returned: 0 in 0.973s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:47 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 Jun 19 04:26:47 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:48 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6" returned: 1 in 0.839s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Downloaded image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 ((None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}])) to volume ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 successfully. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Temporary image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 for user 43aafc21a9db4634a2fe835735c0dcad is deleted. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Marking volume ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 as bootable. {{(pid=93300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Copying metadata from image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 to ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6. {{(pid=93300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Creating volume glance metadata for volume ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 backed by image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bf3aa3-9035-4480-8608-6abb0c08a930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6', 'volume_size': 1, 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dffb3ac9be154db7807c947881bed470', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'created_at': datetime.datetime(2026, 6, 19, 2, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b02ce4e-b0fb-431e-b0e1-04a7ddbfe1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:48 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Volume volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 (ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6): created successfully Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b02ce4e-b0fb-431e-b0e1-04a7ddbfe1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (485842b6-f3be-41b7-a6cd-014eb4fa1246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:48 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-5172970d-1979-4e97-96e1-c003051914d0 tempest-VolumesGetTest-1051702476 None] Created volume successfully. Jun 19 04:26:48 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf" returned: 0 in 2.449s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_426e0a85-c1a1-4a3f-be92-1c8cbeab7084_4y8n0qjkdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:26:48 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Converted 112.00 MB image at 45.72 MB/s Jun 19 04:26:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:48 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf 1G Jun 19 04:26:48 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:49 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf 1G" returned: 0 in 1.144s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:49 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6458a80-0f0c-49c8-abf3-e0b3dd7ea54e]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:49 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf Jun 19 04:26:49 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (3d42f41d-e1b9-47a1-b137-36369c787a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaf8a21-65dd-4299-b123-84328108ee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaf8a21-65dd-4299-b123-84328108ee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-392229041',display_name='tempest-VolumesGetTest-Volume-2003721703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9252c85c-ff74-4b2b-9326-7343327fa739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1938e12aa3e94edf9496bcca01e09cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:51Z,use_quota=True,user_id='43aafc21a9db4634a2fe835735c0dcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01f6e6f-3bab-41ad-82a1-b8380f4f189b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01f6e6f-3bab-41ad-82a1-b8380f4f189b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b4cd01-b0c1-40d2-84af-ee50a6d00400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b4cd01-b0c1-40d2-84af-ee50a6d00400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9252c85c-ff74-4b2b-9326-7343327fa739', 'volume_name': 'volume-9252c85c-ff74-4b2b-9326-7343327fa739', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba33b588-c159-4392-ac71-441d858e8486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba33b588-c159-4392-ac71-441d858e8486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301757bf-3511-4d6b-9268-1906f141de35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:50 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Volume 9252c85c-ff74-4b2b-9326-7343327fa739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9252c85c-ff74-4b2b-9326-7343327fa739', 'volume_size': 1} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-392229041',display_name='tempest-VolumesGetTest-Volume-2003721703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9252c85c-ff74-4b2b-9326-7343327fa739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1938e12aa3e94edf9496bcca01e09cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:51Z,use_quota=True,user_id='43aafc21a9db4634a2fe835735c0dcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Creating volume 9252c85c-ff74-4b2b-9326-7343327fa739 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:50 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:26:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9252c85c-ff74-4b2b-9326-7343327fa739 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:50 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9252c85c-ff74-4b2b-9326-7343327fa739 1073741824 Jun 19 04:26:50 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:51 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf" returned: 0 in 1.504s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:51 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf Jun 19 04:26:51 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Acquiring lock "cinder-14946724-1e21-4e9b-bfbb-a450beb51961-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Lock "cinder-14946724-1e21-4e9b-bfbb-a450beb51961-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Acquiring lock "cinder-quobyte-14946724-1e21-4e9b-bfbb-a450beb51961" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Lock "cinder-quobyte-14946724-1e21-4e9b-bfbb-a450beb51961" acquired by "delete_volume" :: waited 0.031s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:51 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac40110-ba9d-427c-8f92-aa863761a816]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-14946724-1e21-4e9b-bfbb-a450beb51961 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:52 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-14946724-1e21-4e9b-bfbb-a450beb51961 Jun 19 04:26:52 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:52 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9252c85c-ff74-4b2b-9326-7343327fa739 1073741824" returned: 0 in 1.415s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9252c85c-ff74-4b2b-9326-7343327fa739 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:52 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9252c85c-ff74-4b2b-9326-7343327fa739 Jun 19 04:26:52 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf" returned: 1 in 1.276s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:52 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:26:52 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Downloaded image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 ((None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}])) to volume da1a52e6-dfc5-43df-a283-550d2a2e1acf successfully. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:26:52 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Temporary image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 for user 9c2dc51e28574ac79511299f91743cfa is deleted. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:26:52 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Marking volume da1a52e6-dfc5-43df-a283-550d2a2e1acf as bootable. {{(pid=93300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:26:52 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Copying metadata from image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 to da1a52e6-dfc5-43df-a283-550d2a2e1acf. {{(pid=93300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:26:52 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Creating volume glance metadata for volume da1a52e6-dfc5-43df-a283-550d2a2e1acf backed by image 426e0a85-c1a1-4a3f-be92-1c8cbeab7084 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:26:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a3ed5d-c0fe-4290-b965-b1f5940e5ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf', 'volume_size': 1, 'image_id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dffb3ac9be154db7807c947881bed470', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '426e0a85-c1a1-4a3f-be92-1c8cbeab7084', 'created_at': datetime.datetime(2026, 6, 19, 2, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/426e0a85-c1a1-4a3f-be92-1c8cbeab7084/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3fe6ac-ad97-42ac-8ca6-d0179bb02d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:52 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Volume volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf (da1a52e6-dfc5-43df-a283-550d2a2e1acf): created successfully Jun 19 04:26:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3fe6ac-ad97-42ac-8ca6-d0179bb02d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Flow 'volume_create_manager' (03c1f63c-7ac0-4c9a-94e6-a0143564825c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:52 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-263db1a6-d8d9-4318-ac55-d79f3bd7455f tempest-TestShelveInstance-211221398 None] Created volume successfully. Jun 19 04:26:53 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-14946724-1e21-4e9b-bfbb-a450beb51961" returned: 0 in 1.193s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-14946724-1e21-4e9b-bfbb-a450beb51961 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:53 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-14946724-1e21-4e9b-bfbb-a450beb51961 Jun 19 04:26:53 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:53 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9252c85c-ff74-4b2b-9326-7343327fa739" returned: 0 in 1.046s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] <== create_volume: return (2540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.542s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301757bf-3511-4d6b-9268-1906f141de35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9252c85c-ff74-4b2b-9326-7343327fa739', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289135c8-603d-4a5f-8bb2-8fe772c65545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:53 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Volume volume-9252c85c-ff74-4b2b-9326-7343327fa739 (9252c85c-ff74-4b2b-9326-7343327fa739): created successfully Jun 19 04:26:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289135c8-603d-4a5f-8bb2-8fe772c65545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Flow 'volume_create_manager' (3d42f41d-e1b9-47a1-b137-36369c787a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:53 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-6894dd44-6b8e-4146-97e5-784831de0231 tempest-VolumesGetTest-1051702476 None] Created volume successfully. Jun 19 04:26:54 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-14946724-1e21-4e9b-bfbb-a450beb51961" returned: 0 in 0.966s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Lock "cinder-quobyte-14946724-1e21-4e9b-bfbb-a450beb51961" released by "delete_volume" :: held 2.249s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-9252c85c-ff74-4b2b-9326-7343327fa739-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Lock "cinder-9252c85c-ff74-4b2b-9326-7343327fa739-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-quobyte-9252c85c-ff74-4b2b-9326-7343327fa739" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Created reservations ['fa8c66c8-af20-4c68-8a35-357635eb6f53', '51b316ed-7e0c-4349-9ccc-5dca9553e52f', '8f17bba7-d30f-434c-a37d-04baf8156db3', 'b0ef0d68-23dc-4295-ab91-44ad3c73f07d'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-9252c85c-ff74-4b2b-9326-7343327fa739" acquired by "delete_volume" :: waited 0.032s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4c79c8-f15c-4d8e-a127-d5d15f4a5a95]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9252c85c-ff74-4b2b-9326-7343327fa739 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:54 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:26:54 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:54 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9252c85c-ff74-4b2b-9326-7343327fa739 Jun 19 04:26:54 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:55 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.051s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:55 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:55 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Deleted volume successfully. Jun 19 04:26:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e150a289-445e-49e4-b1e8-0d11c1e978b3 tempest-VolumesNegativeTest-1588633875 None] Lock "cinder-14946724-1e21-4e9b-bfbb-a450beb51961-delete_volume" released by "delete_volume" :: held 3.801s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:55 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9252c85c-ff74-4b2b-9326-7343327fa739" returned: 0 in 1.269s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9252c85c-ff74-4b2b-9326-7343327fa739 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:55 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9252c85c-ff74-4b2b-9326-7343327fa739 Jun 19 04:26:55 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:56 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9252c85c-ff74-4b2b-9326-7343327fa739" returned: 0 in 1.035s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-9252c85c-ff74-4b2b-9326-7343327fa739" released by "delete_volume" :: held 2.381s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:56 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Created reservations ['e94e7337-cd56-4cc7-8ee7-dd56a2ecb871', '9cfb8b95-490e-45c1-a897-5394e88127c4', 'cf70dc30-d02d-45d7-bcf2-74d3b3f6e64c', '8bbcafc4-344d-4c04-be29-eba12c4e644f'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:56 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:26:56 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:57 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.890s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:57 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:57 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Deleted volume successfully. Jun 19 04:26:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6613e79d-33a2-43a4-ae4d-dc892e126f2d tempest-VolumesGetTest-1051702476 None] Lock "cinder-9252c85c-ff74-4b2b-9326-7343327fa739-delete_volume" released by "delete_volume" :: held 3.594s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Lock "cinder-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Acquiring lock "cinder-quobyte-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6" acquired by "delete_volume" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:57 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b9eca0-736d-4127-af74-bb739a8b834b]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:58 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 Jun 19 04:26:58 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:59 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6" returned: 0 in 1.101s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:59 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 Jun 19 04:26:59 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:00 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6" returned: 1 in 0.948s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:27:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:00 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6 Jun 19 04:27:00 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:00 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6" returned: 0 in 0.801s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Lock "cinder-quobyte-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6" released by "delete_volume" :: held 2.946s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:00 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Created reservations ['14bc4e68-bb75-4399-bd1a-a92b9803802b', 'e141ebe9-a50f-4904-a084-e8e44a36995f', '8193a6e0-78f2-4319-8f9d-19f7663736a9', '72896b71-64e7-4a09-a1ac-edfc9f9ae1d0'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:01 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:27:01 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-e8f36388-712d-4a8a-a760-a08da5ffbb6d req-d44073ab-0911-469e-b7d2-7dc848bb0379 tempest-TestShelveInstance-211221398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-e8f36388-712d-4a8a-a760-a08da5ffbb6d req-d44073ab-0911-469e-b7d2-7dc848bb0379 tempest-TestShelveInstance-211221398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:02 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.464s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:02 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:02 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Deleted volume successfully. Jun 19 04:27:02 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e0e4b440-8ad8-4cb2-a268-04151121a96a tempest-VolumesGetTest-1051702476 None] Lock "cinder-ae7dd8f2-ae2f-4104-8f57-2fae405c2ff6-delete_volume" released by "delete_volume" :: held 4.711s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:02 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a45f4e-d8e7-4a47-9981-1e238f877a73]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e8f36388-712d-4a8a-a760-a08da5ffbb6d req-d44073ab-0911-469e-b7d2-7dc848bb0379 tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:02 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf Jun 19 04:27:02 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:03 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e8f36388-712d-4a8a-a760-a08da5ffbb6d req-d44073ab-0911-469e-b7d2-7dc848bb0379 tempest-TestShelveInstance-211221398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf" returned: 0 in 1.140s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e8f36388-712d-4a8a-a760-a08da5ffbb6d req-d44073ab-0911-469e-b7d2-7dc848bb0379 tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:03 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf Jun 19 04:27:03 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:04 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e8f36388-712d-4a8a-a760-a08da5ffbb6d req-d44073ab-0911-469e-b7d2-7dc848bb0379 tempest-TestShelveInstance-211221398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf" returned: 1 in 0.843s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e8f36388-712d-4a8a-a760-a08da5ffbb6d req-d44073ab-0911-469e-b7d2-7dc848bb0379 tempest-TestShelveInstance-211221398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:27:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-e8f36388-712d-4a8a-a760-a08da5ffbb6d req-d44073ab-0911-469e-b7d2-7dc848bb0379 tempest-TestShelveInstance-211221398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.077s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-e8f36388-712d-4a8a-a760-a08da5ffbb6d req-d44073ab-0911-469e-b7d2-7dc848bb0379 tempest-TestShelveInstance-211221398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b47a9fdc-1326-4d03-a869-68b75e4c6619', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:27:04 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-e8f36388-712d-4a8a-a760-a08da5ffbb6d req-d44073ab-0911-469e-b7d2-7dc848bb0379 tempest-TestShelveInstance-211221398 None] attachment_update completed successfully. Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Flow 'volume_create_manager' (b0117cf3-482c-4312-94b9-8aa2a79b1749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1488cef-3780-4727-bb77-73d47a3528f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1488cef-3780-4727-bb77-73d47a3528f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1041403329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac91eaaf-c139-4177-85da-f6733e5694d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c241dba8f6446ebe8670a0c9b199d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:08Z,use_quota=True,user_id='b48ebac5cbb84a3fb7dcaac7702da2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0971113-a630-4ec6-a321-ab6b4f859e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0971113-a630-4ec6-a321-ab6b4f859e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b59db9-2e49-4221-ae41-be5286966725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b59db9-2e49-4221-ae41-be5286966725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac91eaaf-c139-4177-85da-f6733e5694d7', 'volume_name': 'volume-ac91eaaf-c139-4177-85da-f6733e5694d7', 'volume_size': 2}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ee9d8d-c577-4f99-b477-19798cff07da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ee9d8d-c577-4f99-b477-19798cff07da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd537afc-3ed1-4750-b350-8a6f048828bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:07 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Volume ac91eaaf-c139-4177-85da-f6733e5694d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac91eaaf-c139-4177-85da-f6733e5694d7', 'volume_size': 2} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1041403329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac91eaaf-c139-4177-85da-f6733e5694d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c241dba8f6446ebe8670a0c9b199d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:08Z,use_quota=True,user_id='b48ebac5cbb84a3fb7dcaac7702da2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Creating volume ac91eaaf-c139-4177-85da-f6733e5694d7 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:07 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:27:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7 2147483648 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:07 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7 2147483648 Jun 19 04:27:07 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:08 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7 2147483648" returned: 0 in 1.131s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:08 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7 Jun 19 04:27:08 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:09 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7" returned: 0 in 0.681s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd537afc-3ed1-4750-b350-8a6f048828bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac91eaaf-c139-4177-85da-f6733e5694d7', 'volume_size': 2}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75149e4d-c4c6-444d-a3c1-5e4bb1e55e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:09 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Volume volume-ac91eaaf-c139-4177-85da-f6733e5694d7 (ac91eaaf-c139-4177-85da-f6733e5694d7): created successfully Jun 19 04:27:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75149e4d-c4c6-444d-a3c1-5e4bb1e55e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Flow 'volume_create_manager' (b0117cf3-482c-4312-94b9-8aa2a79b1749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:09 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-67a01e29-74ca-424c-a838-2d47232830b0 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Created volume successfully. Jun 19 04:27:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Creating offline snapshot ef209b62-3d08-443a-872b-3f2aa90ade9b of volume ac91eaaf-c139-4177-85da-f6733e5694d7 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:27:11 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e2d605-d29b-4c3c-8e3d-83738a713e91]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:11 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7 Jun 19 04:27:11 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:12 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7" returned: 0 in 1.147s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b 2G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:12 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b 2G Jun 19 04:27:12 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:13 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b 2G" returned: 0 in 1.242s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac91eaaf-c139-4177-85da-f6733e5694d7 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:13 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac91eaaf-c139-4177-85da-f6733e5694d7 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b Jun 19 04:27:13 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:14 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac91eaaf-c139-4177-85da-f6733e5694d7 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b" returned: 0 in 0.883s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:14 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b is being set with open permissions: ugo+rw Jun 19 04:27:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:14 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b Jun 19 04:27:14 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:15 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b" returned: 0 in 0.720s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=72,cinder:SELECT=66,cinder:INSERT=24,cinder:DELETE=7 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=72,cinder:SELECT=62,cinder:DELETE=5,cinder:INSERT=32 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:15 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.info Jun 19 04:27:15 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Flow 'volume_create_manager' (ccd4a075-305a-45ab-81e8-1a0d24fc57f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f701dd8d-70d3-4d5b-a42e-2c1d047762e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f701dd8d-70d3-4d5b-a42e-2c1d047762e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2115091549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86be398-bead-465c-8a53-89f29c1ed2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363fd74f6c63424b8d091ba26eec42dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:15Z,use_quota=True,user_id='fefd0f1b70494339993d6f0cb2a867b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57951263-22c0-4f25-a1d7-7efaacc7a3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57951263-22c0-4f25-a1d7-7efaacc7a3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ac3b11-9e68-4afb-9070-0820a2c9f74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ac3b11-9e68-4afb-9070-0820a2c9f74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b86be398-bead-465c-8a53-89f29c1ed2ef', 'volume_name': 'volume-b86be398-bead-465c-8a53-89f29c1ed2ef', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ddfa97-0db3-4ca7-b331-4737e779594a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ddfa97-0db3-4ca7-b331-4737e779594a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677483dd-47a2-40d3-83f2-7e77dccf66c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:15 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Volume b86be398-bead-465c-8a53-89f29c1ed2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b86be398-bead-465c-8a53-89f29c1ed2ef', 'volume_size': 1} Jun 19 04:27:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:16 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.info" returned: 0 in 0.758s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:16 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.info is being set with open permissions: ugo+rw Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:16 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.info Jun 19 04:27:16 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:16 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.info" returned: 0 in 0.687s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.579s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.187s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2115091549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86be398-bead-465c-8a53-89f29c1ed2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363fd74f6c63424b8d091ba26eec42dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:15Z,use_quota=True,user_id='fefd0f1b70494339993d6f0cb2a867b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Creating volume b86be398-bead-465c-8a53-89f29c1ed2ef {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:16 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:27:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:16 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef 1073741824 Jun 19 04:27:16 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3458f6ef-9a8d-4b74-a56d-1fb5f9147455 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Create snapshot completed successfully Jun 19 04:27:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Acquiring lock "cinder-ef209b62-3d08-443a-872b-3f2aa90ade9b-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "cinder-ef209b62-3d08-443a-872b-3f2aa90ade9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Acquiring lock "cinder-quobyte-ac91eaaf-c139-4177-85da-f6733e5694d7" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "cinder-quobyte-ac91eaaf-c139-4177-85da-f6733e5694d7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Acquiring lock "cinder-quobyte-ef209b62-3d08-443a-872b-3f2aa90ade9b" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:17 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "cinder-quobyte-ef209b62-3d08-443a-872b-3f2aa90ade9b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Deleting offline snapshot ef209b62-3d08-443a-872b-3f2aa90ade9b of volume ac91eaaf-c139-4177-85da-f6733e5694d7 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:27:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] snapshot_file for this snap is: volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:27:17 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0800e0-063c-4d10-accc-544bcec36560]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:17 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef 1073741824" returned: 0 in 0.993s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:17 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef Jun 19 04:27:17 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:17 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b Jun 19 04:27:17 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:18 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef" returned: 0 in 0.874s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677483dd-47a2-40d3-83f2-7e77dccf66c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86be398-bead-465c-8a53-89f29c1ed2ef', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582cdd48-85ed-44ff-b8b8-d6403cb4b88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:18 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Volume volume-b86be398-bead-465c-8a53-89f29c1ed2ef (b86be398-bead-465c-8a53-89f29c1ed2ef): created successfully Jun 19 04:27:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582cdd48-85ed-44ff-b8b8-d6403cb4b88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:18 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Flow 'volume_create_manager' (ccd4a075-305a-45ab-81e8-1a0d24fc57f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b" returned: 0 in 1.004s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac91eaaf-c139-4177-85da-f6733e5694d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:27:18 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b02f0f-6a44-4f53-8b74-12929a6cfccc]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:18 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b3089c43-64d7-4323-a5e8-89b351a941c5 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Created volume successfully. Jun 19 04:27:18 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7 Jun 19 04:27:18 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:27:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:19 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:27:19 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:20 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7" returned: 0 in 1.693s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:20 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b Jun 19 04:27:20 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:20 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.608s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:20 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:27:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 29 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:27:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:27:21 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b" returned: 0 in 1.307s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:21 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b Jun 19 04:27:21 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:23 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7.ef209b62-3d08-443a-872b-3f2aa90ade9b" returned: 0 in 1.341s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:23 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "cinder-quobyte-ef209b62-3d08-443a-872b-3f2aa90ade9b" released by "_delete_snapshot" :: held 5.513s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:23 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "cinder-quobyte-ac91eaaf-c139-4177-85da-f6733e5694d7" released by "delete_snapshot" :: held 5.542s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:23 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Created reservations ['1c716b02-f351-4b9d-ac23-3cd1d707df5e', 'c19c9e5b-f054-4698-881a-6f6e91e69bd9', 'c71f1575-4eac-44ee-998a-00bfe2b8f3b2', '75b06315-2404-42e9-8ab0-7b8b32cd930b'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:23 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Delete snapshot completed successfully. Jun 19 04:27:23 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-76dbf0f0-672b-4e7a-be56-1bf3529b6360 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "cinder-ef209b62-3d08-443a-872b-3f2aa90ade9b-delete_snapshot" released by "delete_snapshot" :: held 5.841s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-0f12a1c7-d06f-4440-bb3f-999d42aeab41 req-8daa14cb-94fe-4176-8312-323b128aa1af tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-0f12a1c7-d06f-4440-bb3f-999d42aeab41 req-8daa14cb-94fe-4176-8312-323b128aa1af tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:23 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8a4808-f0cd-4d26-a801-b7907ae39868]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-0f12a1c7-d06f-4440-bb3f-999d42aeab41 req-8daa14cb-94fe-4176-8312-323b128aa1af tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:24 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef Jun 19 04:27:24 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Acquiring lock "cinder-ac91eaaf-c139-4177-85da-f6733e5694d7-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "cinder-ac91eaaf-c139-4177-85da-f6733e5694d7-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Acquiring lock "cinder-quobyte-ac91eaaf-c139-4177-85da-f6733e5694d7" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "cinder-quobyte-ac91eaaf-c139-4177-85da-f6733e5694d7" acquired by "delete_volume" :: waited 0.072s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:24 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd75a518-b4c0-4abd-b35d-f07261127dee]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:24 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7 Jun 19 04:27:25 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:25 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-0f12a1c7-d06f-4440-bb3f-999d42aeab41 req-8daa14cb-94fe-4176-8312-323b128aa1af tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef" returned: 0 in 1.851s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-0f12a1c7-d06f-4440-bb3f-999d42aeab41 req-8daa14cb-94fe-4176-8312-323b128aa1af tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.881s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:25 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-0f12a1c7-d06f-4440-bb3f-999d42aeab41 req-8daa14cb-94fe-4176-8312-323b128aa1af tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-b86be398-bead-465c-8a53-89f29c1ed2ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7931db78-ef70-4b7d-9a9e-cca597629bf4', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:27:25 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-0f12a1c7-d06f-4440-bb3f-999d42aeab41 req-8daa14cb-94fe-4176-8312-323b128aa1af tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] attachment_update completed successfully. Jun 19 04:27:26 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7" returned: 0 in 1.664s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:26 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7 Jun 19 04:27:26 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:27 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ac91eaaf-c139-4177-85da-f6733e5694d7" returned: 0 in 1.403s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:27 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "cinder-quobyte-ac91eaaf-c139-4177-85da-f6733e5694d7" released by "delete_volume" :: held 3.205s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:27 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Created reservations ['98ab341a-afce-4828-b1a4-5900fb275d31', '0f1c2314-b825-4e38-8a35-8dee76f2e858', '57e0fc8f-0626-4b44-86a3-cfa1a65fafc4', '9dbb9985-ea7a-4012-858f-e49d135f10fd'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:28 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:27:28 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:28 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.872s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:28 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:28 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Deleted volume successfully. Jun 19 04:27:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1ac05746-cb6b-46ee-b881-df1274560617 tempest-VolumesSnapshotNegativeTestJSON-1559614546 None] Lock "cinder-ac91eaaf-c139-4177-85da-f6733e5694d7-delete_volume" released by "delete_volume" :: held 4.610s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:34 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-3b351859-f236-488e-a66f-661bb557feff req-a25440a8-0899-409e-80d7-133881479b87 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Terminate volume connection completed successfully. Jun 19 04:27:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-3b351859-f236-488e-a66f-661bb557feff req-a25440a8-0899-409e-80d7-133881479b87 tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Deleting attachment 7931db78-ef70-4b7d-9a9e-cca597629bf4. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:27:35 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Flow 'volume_create_manager' (8b18560d-671a-42b1-a9a1-497437872e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d76b2a-177b-44ca-abe4-c436ab8f9779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d76b2a-177b-44ca-abe4-c436ab8f9779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0b09b7-f561-40f6-9590-125135b2a8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01bc0a30111d4c4cb4bf0d749afaa7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:36Z,use_quota=True,user_id='de95547a657c418d87ff527873570a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633a4cf5-e640-4f68-a955-b53745686709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633a4cf5-e640-4f68-a955-b53745686709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64ae2af-fb13-42dd-aa7d-9c2ae295d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.image.glance [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Creating Keystone auth plugin from conf {{(pid=93300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64ae2af-fb13-42dd-aa7d-9c2ae295d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd0b09b7-f561-40f6-9590-125135b2a8d7', 'volume_name': 'volume-cd0b09b7-f561-40f6-9590-125135b2a8d7', 'volume_size': 1, 'image_id': '86b08404-230e-4135-a37a-365620618caf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86b08404-230e-4135-a37a-365620618caf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '449893cd8ade7890f03f9fa810b2a9de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01bc0a30111d4c4cb4bf0d749afaa7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a652501a3f19bb7d1ef80fe99031032e1c5ac2eeba9bb149e2cda2a73f0884a4fa45752a7df65d4c5e4b58e8385a7954da23d5a7cf99f832e8e0a2d8f0fc40aa', 'id': '86b08404-230e-4135-a37a-365620618caf', 'created_at': datetime.datetime(2026, 6, 19, 2, 27, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 27, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86b08404-230e-4135-a37a-365620618caf/file', 'properties': {}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3dba6c0-db22-451f-b867-85cbea29aba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3dba6c0-db22-451f-b867-85cbea29aba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0578e2-9af6-493f-93d2-67f04dfd1265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:36 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Volume cd0b09b7-f561-40f6-9590-125135b2a8d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd0b09b7-f561-40f6-9590-125135b2a8d7', 'volume_size': 1, 'image_id': '86b08404-230e-4135-a37a-365620618caf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86b08404-230e-4135-a37a-365620618caf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '449893cd8ade7890f03f9fa810b2a9de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01bc0a30111d4c4cb4bf0d749afaa7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a652501a3f19bb7d1ef80fe99031032e1c5ac2eeba9bb149e2cda2a73f0884a4fa45752a7df65d4c5e4b58e8385a7954da23d5a7cf99f832e8e0a2d8f0fc40aa', 'id': '86b08404-230e-4135-a37a-365620618caf', 'created_at': datetime.datetime(2026, 6, 19, 2, 27, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 27, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86b08404-230e-4135-a37a-365620618caf/file', 'properties': {}}, 'image_service': } Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Trying to clone cd0b09b7-f561-40f6-9590-125135b2a8d7 from image 86b08404-230e-4135-a37a-365620618caf at location (None, [{'url': 'file:///opt/stack/data/glance/images/86b08404-230e-4135-a37a-365620618caf', 'metadata': {}}]). {{(pid=93300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:27:36 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Image download 0.00 MB at 0.00 MB/s Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d11948-98f9-4212-8750-019a8664b879]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:36 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD Jun 19 04:27:36 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Acquiring lock "cinder-b86be398-bead-465c-8a53-89f29c1ed2ef-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Lock "cinder-b86be398-bead-465c-8a53-89f29c1ed2ef-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Acquiring lock "cinder-quobyte-b86be398-bead-465c-8a53-89f29c1ed2ef" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Lock "cinder-quobyte-b86be398-bead-465c-8a53-89f29c1ed2ef" acquired by "delete_volume" :: waited 0.026s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce1bded-4479-409c-ac87-2f973a041f28]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:37 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef Jun 19 04:27:37 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:37 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD" returned: 0 in 0.869s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:37 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD Jun 19 04:27:37 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:37 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef" returned: 0 in 0.824s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:37 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef Jun 19 04:27:37 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:38 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD" returned: 1 in 0.862s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Temporary image 86b08404-230e-4135-a37a-365620618caf is fetched for user de95547a657c418d87ff527873570a5d. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1cf788-90fd-45b7-bae4-e4bda9e36ef1]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:38 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD Jun 19 04:27:38 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:38 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b86be398-bead-465c-8a53-89f29c1ed2ef" returned: 0 in 0.925s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Lock "cinder-quobyte-b86be398-bead-465c-8a53-89f29c1ed2ef" released by "delete_volume" :: held 1.817s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Created reservations ['5e2f4a19-2369-49a0-a720-32c096906683', 'e611d47d-b122-441e-a751-08aa9b2408a4', '906db3bf-ed5f-40bc-9dc5-29d2738fffb1', '6a9e2a6e-cd5d-4521-ad22-c6d3ceb0afbf'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:38 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:27:38 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:39 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD" returned: 0 in 0.919s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:39 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD Jun 19 04:27:39 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:39 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.028s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:39 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:39 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Deleted volume successfully. Jun 19 04:27:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5c7f12d5-f2cb-48b2-a050-b7dd89b0a8fa tempest-TestServerVolumeAttachScenarioOldVersion-1202604801 None] Lock "cinder-b86be398-bead-465c-8a53-89f29c1ed2ef-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:40 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD" returned: 1 in 1.099s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:27:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0b09b7-f561-40f6-9590-125135b2a8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01bc0a30111d4c4cb4bf0d749afaa7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:36Z,use_quota=True,user_id='de95547a657c418d87ff527873570a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Creating volume cd0b09b7-f561-40f6-9590-125135b2a8d7 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:40 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:27:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:40 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 1073741824 Jun 19 04:27:40 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:41 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 1073741824" returned: 0 in 1.324s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:41 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 Jun 19 04:27:41 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:42 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7" returned: 0 in 0.746s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] <== create_volume: return (2130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.146s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:42 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Attempting download of 86b08404-230e-4135-a37a-365620618caf ((None, [{'url': 'file:///opt/stack/data/glance/images/86b08404-230e-4135-a37a-365620618caf', 'metadata': {}}])) to volume cd0b09b7-f561-40f6-9590-125135b2a8d7. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:27:42 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bdfa46-29f0-41e4-ba59-734036182ab5]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86b08404-230e-4135-a37a-365620618caf_3t2nus92 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:42 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86b08404-230e-4135-a37a-365620618caf_3t2nus92 Jun 19 04:27:42 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:43 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86b08404-230e-4135-a37a-365620618caf_3t2nus92" returned: 0 in 0.809s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86b08404-230e-4135-a37a-365620618caf_3t2nus92 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:43 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86b08404-230e-4135-a37a-365620618caf_3t2nus92 Jun 19 04:27:43 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:44 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86b08404-230e-4135-a37a-365620618caf_3t2nus92" returned: 1 in 0.737s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86b08404-230e-4135-a37a-365620618caf_3t2nus92' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:27:44 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[966dbb7a-b1e6-47ac-8a57-bff068238e66]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:44 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD Jun 19 04:27:44 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:44 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD" returned: 0 in 0.732s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:44 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD Jun 19 04:27:44 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:45 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD" returned: 1 in 0.783s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:27:45 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] 86b08404-230e-4135-a37a-365620618caf was raw, converting to raw {{(pid=93300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:27:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:45 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 Jun 19 04:27:45 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:47 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7" returned: 0 in 1.378s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:47 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86b08404-230e-4135-a37a-365620618caf_zjqyz3m5devstack@QuobyteHD, size 0.00 MB, duration 1.38 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:27:47 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Converted 0.00 MB image at 0.00 MB/s Jun 19 04:27:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:47 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 1G Jun 19 04:27:47 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:47 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 1G" returned: 0 in 0.915s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:48 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10746e4-553e-452c-b8f0-50f44e306d1f]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:48 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 Jun 19 04:27:48 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:49 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7" returned: 0 in 1.111s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:49 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 Jun 19 04:27:49 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:50 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7" returned: 1 in 1.206s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:27:50 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Downloaded image 86b08404-230e-4135-a37a-365620618caf ((None, [{'url': 'file:///opt/stack/data/glance/images/86b08404-230e-4135-a37a-365620618caf', 'metadata': {}}])) to volume cd0b09b7-f561-40f6-9590-125135b2a8d7 successfully. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:27:50 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Temporary image 86b08404-230e-4135-a37a-365620618caf for user de95547a657c418d87ff527873570a5d is deleted. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:27:50 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Marking volume cd0b09b7-f561-40f6-9590-125135b2a8d7 as bootable. {{(pid=93300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:27:50 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Copying metadata from image 86b08404-230e-4135-a37a-365620618caf to cd0b09b7-f561-40f6-9590-125135b2a8d7. {{(pid=93300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:27:50 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Creating volume glance metadata for volume cd0b09b7-f561-40f6-9590-125135b2a8d7 backed by image 86b08404-230e-4135-a37a-365620618caf with: {'image_id': '86b08404-230e-4135-a37a-365620618caf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '449893cd8ade7890f03f9fa810b2a9de', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:27:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0578e2-9af6-493f-93d2-67f04dfd1265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd0b09b7-f561-40f6-9590-125135b2a8d7', 'volume_size': 1, 'image_id': '86b08404-230e-4135-a37a-365620618caf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86b08404-230e-4135-a37a-365620618caf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '449893cd8ade7890f03f9fa810b2a9de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01bc0a30111d4c4cb4bf0d749afaa7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a652501a3f19bb7d1ef80fe99031032e1c5ac2eeba9bb149e2cda2a73f0884a4fa45752a7df65d4c5e4b58e8385a7954da23d5a7cf99f832e8e0a2d8f0fc40aa', 'id': '86b08404-230e-4135-a37a-365620618caf', 'created_at': datetime.datetime(2026, 6, 19, 2, 27, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 27, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86b08404-230e-4135-a37a-365620618caf/file', 'properties': {}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd27837e-1d94-48f7-9ed1-48b171975e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:50 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Volume volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 (cd0b09b7-f561-40f6-9590-125135b2a8d7): created successfully Jun 19 04:27:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd27837e-1d94-48f7-9ed1-48b171975e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Flow 'volume_create_manager' (8b18560d-671a-42b1-a9a1-497437872e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:50 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b39cff30-f5a2-46e4-b383-f41aff697908 tempest-VolumeImageDependencyTests-328426391 None] Created volume successfully. Jun 19 04:27:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Acquiring lock "cinder-cd0b09b7-f561-40f6-9590-125135b2a8d7-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Lock "cinder-cd0b09b7-f561-40f6-9590-125135b2a8d7-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Acquiring lock "cinder-quobyte-cd0b09b7-f561-40f6-9590-125135b2a8d7" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Lock "cinder-quobyte-cd0b09b7-f561-40f6-9590-125135b2a8d7" acquired by "delete_volume" :: waited 0.035s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:51 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e5056a-1e98-4a14-80c6-e39b8d87c7d9]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:51 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 Jun 19 04:27:51 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Flow 'volume_create_manager' (54241b0e-3aad-494f-97fc-4de877ebc19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4d8165-6329-4d13-be58-dd938a3ebf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4d8165-6329-4d13-be58-dd938a3ebf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-88376797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f536ff2e-f937-4ef8-9e61-086272459034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452e239e0c9f406d95bcb0952fed679b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:52Z,use_quota=True,user_id='fbf1ad777fdb41e28c7bb39eda90ba7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12af5eaa-51f0-4bc8-9413-6499ed245d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12af5eaa-51f0-4bc8-9413-6499ed245d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3288c79-9fcf-4af7-ba2c-ca8136701721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3288c79-9fcf-4af7-ba2c-ca8136701721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f536ff2e-f937-4ef8-9e61-086272459034', 'volume_name': 'volume-f536ff2e-f937-4ef8-9e61-086272459034', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6ac3ae-a582-4722-a9cf-f62149e29888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6ac3ae-a582-4722-a9cf-f62149e29888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94baae2a-7c3c-4c80-939f-a0b90cbc0b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Volume f536ff2e-f937-4ef8-9e61-086272459034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f536ff2e-f937-4ef8-9e61-086272459034', 'volume_size': 1} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-88376797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f536ff2e-f937-4ef8-9e61-086272459034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452e239e0c9f406d95bcb0952fed679b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:52Z,use_quota=True,user_id='fbf1ad777fdb41e28c7bb39eda90ba7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Creating volume f536ff2e-f937-4ef8-9e61-086272459034 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:52 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:27:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:52 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034 1073741824 Jun 19 04:27:52 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:53 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7" returned: 0 in 1.725s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:53 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 Jun 19 04:27:53 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:54 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034 1073741824" returned: 0 in 1.978s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:54 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034 Jun 19 04:27:54 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:54 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7" returned: 1 in 1.268s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:27:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:54 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7 Jun 19 04:27:54 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:55 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-cd0b09b7-f561-40f6-9590-125135b2a8d7" returned: 0 in 1.025s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:55 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034" returned: 0 in 1.152s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] <== create_volume: return (3206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.214s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Lock "cinder-quobyte-cd0b09b7-f561-40f6-9590-125135b2a8d7" released by "delete_volume" :: held 4.188s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94baae2a-7c3c-4c80-939f-a0b90cbc0b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f536ff2e-f937-4ef8-9e61-086272459034', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2904a497-64b5-4330-823b-023a07da0388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:55 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Volume volume-f536ff2e-f937-4ef8-9e61-086272459034 (f536ff2e-f937-4ef8-9e61-086272459034): created successfully Jun 19 04:27:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2904a497-64b5-4330-823b-023a07da0388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Flow 'volume_create_manager' (54241b0e-3aad-494f-97fc-4de877ebc19d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:55 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-a56e9294-c4be-432d-b598-d1cf4c9cff93 tempest-TestMinimumBasicScenario-1729299603 None] Created volume successfully. Jun 19 04:27:55 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Created reservations ['8f8ffd59-2ee7-4502-b5f5-01c2389b9ef4', 'dc850c10-7281-48ec-af80-d35387cd58aa', 'e64391bd-4c48-4c5b-b43d-28282e91040a', 'd7e3dcee-bc9e-4599-9016-74694eb34822'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:56 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:27:56 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:57 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.249s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:57 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:57 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Deleted volume successfully. Jun 19 04:27:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6eea0918-a464-47dd-b4a4-f8a6d5264de4 tempest-VolumeImageDependencyTests-328426391 None] Lock "cinder-cd0b09b7-f561-40f6-9590-125135b2a8d7-delete_volume" released by "delete_volume" :: held 5.965s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:58 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-8ba74b70-fcdc-4767-b99b-89cb247f8623 req-4deb07d9-df32-47da-b893-5e223f2f0878 tempest-TestShelveInstance-211221398 None] Terminate volume connection completed successfully. Jun 19 04:27:58 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-8ba74b70-fcdc-4767-b99b-89cb247f8623 req-4deb07d9-df32-47da-b893-5e223f2f0878 tempest-TestShelveInstance-211221398 None] Deleting attachment b47a9fdc-1326-4d03-a869-68b75e4c6619. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:28:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-30ca4c15-ddfb-49b7-bcf8-f27cd80fbcc7 req-4f4cf6ae-c48e-4514-b31c-c9611a419700 tempest-TestMinimumBasicScenario-1729299603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-30ca4c15-ddfb-49b7-bcf8-f27cd80fbcc7 req-4f4cf6ae-c48e-4514-b31c-c9611a419700 tempest-TestMinimumBasicScenario-1729299603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:00 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1558c77-8115-46da-a958-abb00930bb26]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-30ca4c15-ddfb-49b7-bcf8-f27cd80fbcc7 req-4f4cf6ae-c48e-4514-b31c-c9611a419700 tempest-TestMinimumBasicScenario-1729299603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:00 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034 Jun 19 04:28:00 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:01 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-30ca4c15-ddfb-49b7-bcf8-f27cd80fbcc7 req-4f4cf6ae-c48e-4514-b31c-c9611a419700 tempest-TestMinimumBasicScenario-1729299603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034" returned: 0 in 1.152s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-30ca4c15-ddfb-49b7-bcf8-f27cd80fbcc7 req-4f4cf6ae-c48e-4514-b31c-c9611a419700 tempest-TestMinimumBasicScenario-1729299603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.177s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:01 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-30ca4c15-ddfb-49b7-bcf8-f27cd80fbcc7 req-4f4cf6ae-c48e-4514-b31c-c9611a419700 tempest-TestMinimumBasicScenario-1729299603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-f536ff2e-f937-4ef8-9e61-086272459034', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a560045-fa6f-4bf7-a3b8-28b5e10a67e4', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:28:01 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-30ca4c15-ddfb-49b7-bcf8-f27cd80fbcc7 req-4f4cf6ae-c48e-4514-b31c-c9611a419700 tempest-TestMinimumBasicScenario-1729299603 None] attachment_update completed successfully. Jun 19 04:28:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-95a48e9d-e51b-4873-ade1-48ef719164b6 req-a944d6d0-9ee5-4d65-8bee-2e184158efb7 tempest-TestShelveInstance-211221398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-95a48e9d-e51b-4873-ade1-48ef719164b6 req-a944d6d0-9ee5-4d65-8bee-2e184158efb7 tempest-TestShelveInstance-211221398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:05 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e94d9f-7963-448a-b23d-fc1ee7de0fb3]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-95a48e9d-e51b-4873-ade1-48ef719164b6 req-a944d6d0-9ee5-4d65-8bee-2e184158efb7 tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:05 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf Jun 19 04:28:05 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:06 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-95a48e9d-e51b-4873-ade1-48ef719164b6 req-a944d6d0-9ee5-4d65-8bee-2e184158efb7 tempest-TestShelveInstance-211221398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf" returned: 0 in 0.936s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-95a48e9d-e51b-4873-ade1-48ef719164b6 req-a944d6d0-9ee5-4d65-8bee-2e184158efb7 tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:06 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf Jun 19 04:28:06 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:07 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-95a48e9d-e51b-4873-ade1-48ef719164b6 req-a944d6d0-9ee5-4d65-8bee-2e184158efb7 tempest-TestShelveInstance-211221398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf" returned: 1 in 1.090s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-95a48e9d-e51b-4873-ade1-48ef719164b6 req-a944d6d0-9ee5-4d65-8bee-2e184158efb7 tempest-TestShelveInstance-211221398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:28:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-95a48e9d-e51b-4873-ade1-48ef719164b6 req-a944d6d0-9ee5-4d65-8bee-2e184158efb7 tempest-TestShelveInstance-211221398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.067s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-95a48e9d-e51b-4873-ade1-48ef719164b6 req-a944d6d0-9ee5-4d65-8bee-2e184158efb7 tempest-TestShelveInstance-211221398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23ad871b-8c36-4ae8-8de6-4922ec6cb75d', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:28:07 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-95a48e9d-e51b-4873-ade1-48ef719164b6 req-a944d6d0-9ee5-4d65-8bee-2e184158efb7 tempest-TestShelveInstance-211221398 None] attachment_update completed successfully. Jun 19 04:28:17 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=48,cinder:DELETE=4,cinder:UPDATE=48,cinder:INSERT=14 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:28:17 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=56,cinder:UPDATE=43,cinder:INSERT=15,cinder:DELETE=3 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:28:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:28:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:19 devstack sudo[109369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:28:19 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:19 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.721s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:19 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:28:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 29 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:28:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Flow 'volume_create_manager' (b5cc88c5-b577-4658-a9c6-e781e4eebc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c79c0a2-4b6a-4905-a1dd-a0d5887c7647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c79c0a2-4b6a-4905-a1dd-a0d5887c7647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1278762274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa4a0cb-ecd6-4260-a914-73957e0938a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e718812c3c804ca292ee11f81523f025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:32Z,use_quota=True,user_id='a0459fc683224d0c92db76453df551f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12256f9-dd67-410c-b98e-605b90bf4188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12256f9-dd67-410c-b98e-605b90bf4188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36afa585-bfed-4fa5-b478-38fcb1842b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36afa585-bfed-4fa5-b478-38fcb1842b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fa4a0cb-ecd6-4260-a914-73957e0938a7', 'volume_name': 'volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8689774-3dde-49bd-950c-f0cb26a1676c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8689774-3dde-49bd-950c-f0cb26a1676c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29bd3c11-78aa-470c-99bd-cfb2b4064844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:32 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Volume 7fa4a0cb-ecd6-4260-a914-73957e0938a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7', 'volume_size': 1} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1278762274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa4a0cb-ecd6-4260-a914-73957e0938a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e718812c3c804ca292ee11f81523f025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:32Z,use_quota=True,user_id='a0459fc683224d0c92db76453df551f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Creating volume 7fa4a0cb-ecd6-4260-a914-73957e0938a7 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:32 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:28:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:32 devstack sudo[109483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7 1073741824 Jun 19 04:28:32 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:33 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7 1073741824" returned: 0 in 1.056s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:33 devstack sudo[109513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7 Jun 19 04:28:33 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:34 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7" returned: 0 in 0.737s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29bd3c11-78aa-470c-99bd-cfb2b4064844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55becb46-3a89-4676-976d-30f9771a62e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:34 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Volume volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7 (7fa4a0cb-ecd6-4260-a914-73957e0938a7): created successfully Jun 19 04:28:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55becb46-3a89-4676-976d-30f9771a62e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Flow 'volume_create_manager' (b5cc88c5-b577-4658-a9c6-e781e4eebc92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:34 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e0fbff41-cae2-4853-aa8b-5e12f4321ad0 tempest-TestStampPattern-1924381596 None] Created volume successfully. Jun 19 04:28:44 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:28:44 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:29:07 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-e16b3688-a18b-4d44-8774-59159fba1971 req-83fe04d5-81d5-4184-ab68-e2a6dce07945 tempest-TestShelveInstance-211221398 None] Terminate volume connection completed successfully. Jun 19 04:29:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-e16b3688-a18b-4d44-8774-59159fba1971 req-83fe04d5-81d5-4184-ab68-e2a6dce07945 tempest-TestShelveInstance-211221398 None] Deleting attachment 23ad871b-8c36-4ae8-8de6-4922ec6cb75d. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:29:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Acquiring lock "cinder-da1a52e6-dfc5-43df-a283-550d2a2e1acf-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Lock "cinder-da1a52e6-dfc5-43df-a283-550d2a2e1acf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Acquiring lock "cinder-quobyte-da1a52e6-dfc5-43df-a283-550d2a2e1acf" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Lock "cinder-quobyte-da1a52e6-dfc5-43df-a283-550d2a2e1acf" acquired by "delete_volume" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:08 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a9b7fb-1abd-4771-9323-c42689aa59c7]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:08 devstack sudo[109851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf Jun 19 04:29:08 devstack sudo[109851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:09 devstack sudo[109851]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf" returned: 0 in 0.752s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:09 devstack sudo[109855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf Jun 19 04:29:09 devstack sudo[109855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:10 devstack sudo[109855]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf" returned: 1 in 0.762s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:29:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:10 devstack sudo[109861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf Jun 19 04:29:10 devstack sudo[109861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:10 devstack sudo[109861]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da1a52e6-dfc5-43df-a283-550d2a2e1acf" returned: 0 in 0.638s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Lock "cinder-quobyte-da1a52e6-dfc5-43df-a283-550d2a2e1acf" released by "delete_volume" :: held 2.217s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:10 devstack cinder-volume[93300]: DEBUG cinder.quota [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Created reservations ['5a26bd2e-a471-48df-bc20-6812d916eb9e', '358668fe-a442-4b8c-ad91-7b8c822fc8cd', '0888b960-6c88-4dcf-98b4-9ec090521b10', 'ce628f8d-df33-4a12-b78c-04f487354ea1'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:10 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:10 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:10 devstack sudo[109864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:29:10 devstack sudo[109864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:11 devstack sudo[109864]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.675s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:11 devstack cinder-volume[93300]: DEBUG cinder.manager [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:11 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Deleted volume successfully. Jun 19 04:29:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [req-e16b3688-a18b-4d44-8774-59159fba1971 req-e8d09137-2589-4217-b096-882f656472da tempest-TestShelveInstance-211221398 None] Lock "cinder-da1a52e6-dfc5-43df-a283-550d2a2e1acf-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-0d25a830-5130-4ce7-9783-67447d738c43 req-6b79a1a5-6bae-4fb7-9fb8-e4577824e7bf tempest-TestStampPattern-1924381596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-0d25a830-5130-4ce7-9783-67447d738c43 req-6b79a1a5-6bae-4fb7-9fb8-e4577824e7bf tempest-TestStampPattern-1924381596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:15 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba405caf-03c6-43c0-a656-d43f3e68fc91]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-0d25a830-5130-4ce7-9783-67447d738c43 req-6b79a1a5-6bae-4fb7-9fb8-e4577824e7bf tempest-TestStampPattern-1924381596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:16 devstack sudo[109892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7 Jun 19 04:29:16 devstack sudo[109892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:16 devstack sudo[109892]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-0d25a830-5130-4ce7-9783-67447d738c43 req-6b79a1a5-6bae-4fb7-9fb8-e4577824e7bf tempest-TestStampPattern-1924381596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7" returned: 0 in 0.907s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-0d25a830-5130-4ce7-9783-67447d738c43 req-6b79a1a5-6bae-4fb7-9fb8-e4577824e7bf tempest-TestStampPattern-1924381596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.939s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:16 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-0d25a830-5130-4ce7-9783-67447d738c43 req-6b79a1a5-6bae-4fb7-9fb8-e4577824e7bf tempest-TestStampPattern-1924381596 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20b7c091-7618-434b-9f4f-1ec8b4bef1b2', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:29:17 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-0d25a830-5130-4ce7-9783-67447d738c43 req-6b79a1a5-6bae-4fb7-9fb8-e4577824e7bf tempest-TestStampPattern-1924381596 None] attachment_update completed successfully. Jun 19 04:29:17 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-6a0b40ad-ff93-4b11-85bd-25cf77a9a0b9 req-bc572287-edb9-401f-b8b3-7d4c52272d6f tempest-TestMinimumBasicScenario-1729299603 None] Terminate volume connection completed successfully. Jun 19 04:29:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-6a0b40ad-ff93-4b11-85bd-25cf77a9a0b9 req-bc572287-edb9-401f-b8b3-7d4c52272d6f tempest-TestMinimumBasicScenario-1729299603 None] Deleting attachment 0a560045-fa6f-4bf7-a3b8-28b5e10a67e4. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:29:18 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-0d25a830-5130-4ce7-9783-67447d738c43 req-2470a2d6-331a-49ff-a218-74b862b8de79 tempest-TestStampPattern-1924381596 None] Terminate volume connection completed successfully. Jun 19 04:29:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-0d25a830-5130-4ce7-9783-67447d738c43 req-2470a2d6-331a-49ff-a218-74b862b8de79 tempest-TestStampPattern-1924381596 None] Deleting attachment 20b7c091-7618-434b-9f4f-1ec8b4bef1b2. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:19 devstack sudo[109908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:29:19 devstack sudo[109908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Acquiring lock "cinder-f536ff2e-f937-4ef8-9e61-086272459034-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Lock "cinder-f536ff2e-f937-4ef8-9e61-086272459034-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Acquiring lock "cinder-quobyte-f536ff2e-f937-4ef8-9e61-086272459034" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Lock "cinder-quobyte-f536ff2e-f937-4ef8-9e61-086272459034" acquired by "delete_volume" :: waited 0.028s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[095ef949-1291-4a61-b269-75393499aca8]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:19 devstack sudo[109908]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.773s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 29 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:29:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:29:20 devstack sudo[109912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034 Jun 19 04:29:20 devstack sudo[109912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:20 devstack sudo[109912]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034" returned: 0 in 0.853s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:20 devstack sudo[109919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034 Jun 19 04:29:20 devstack sudo[109919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:21 devstack sudo[109919]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-f536ff2e-f937-4ef8-9e61-086272459034" returned: 0 in 0.706s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Lock "cinder-quobyte-f536ff2e-f937-4ef8-9e61-086272459034" released by "delete_volume" :: held 1.617s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:21 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Created reservations ['f82d4c79-4692-422c-975d-fc4b57260e8a', 'a6317573-632e-4409-8c0d-c7503584f8e1', '4bff235e-181c-4ec2-8c23-e35e89461661', '5cf969f7-e468-4b46-ac57-3108d5c064d2'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:21 devstack sudo[109922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:29:21 devstack sudo[109922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:22 devstack sudo[109922]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.811s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:22 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:22 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Deleted volume successfully. Jun 19 04:29:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3f4ba865-2edc-4ce7-be47-797ca868f3d4 tempest-TestMinimumBasicScenario-1729299603 None] Lock "cinder-f536ff2e-f937-4ef8-9e61-086272459034-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:27 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:29:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Flow 'volume_create_manager' (7182837f-2bc7-4486-8f53-3eb32e7e6b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ab0d85-e3cd-4fb3-bc7e-d772afd1b68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ab0d85-e3cd-4fb3-bc7e-d772afd1b68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f54ea2-c7e4-4df9-88c8-6ba88563210f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559ec053fd5743a7bcd647c94572058e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:28Z,use_quota=True,user_id='a21778fd6a9b4e0aa4939fa18884c721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3da82ed6-59ce-4f32-aa74-67c4b6d97625),volume_type_id=3da82ed6-59ce-4f32-aa74-67c4b6d97625)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5a67dd-5618-49c0-883c-e29419e2c1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5a67dd-5618-49c0-883c-e29419e2c1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751e122c-6a7b-4397-8858-c9a4868584f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:27 devstack cinder-volume[93300]: DEBUG cinder.image.glance [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Creating Keystone auth plugin from conf {{(pid=93300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:29:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751e122c-6a7b-4397-8858-c9a4868584f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '25f54ea2-c7e4-4df9-88c8-6ba88563210f', 'volume_name': 'volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f', 'volume_size': 1, 'image_id': 'eb9d1452-5bff-4917-96fa-35cafc5b4d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb9d1452-5bff-4917-96fa-35cafc5b4d6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd838f181a4d280fe1ac6a9f7eb8b4839', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '559ec053fd5743a7bcd647c94572058e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ed78300b04e8ad891a542f375f7966e71e148ee9b46df117cd04326b5668f9cea7d17b39b48a7d16ff8f031971eaf570dd084c0d2e6ef0ef9399f0a2bf7e92b', 'id': 'eb9d1452-5bff-4917-96fa-35cafc5b4d6d', 'created_at': datetime.datetime(2026, 6, 19, 2, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 29, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb9d1452-5bff-4917-96fa-35cafc5b4d6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912e6650-fb6a-4133-bc8f-79d7eb542daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912e6650-fb6a-4133-bc8f-79d7eb542daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd31e698-036e-48a3-81fb-16fc9f708046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:27 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Volume 25f54ea2-c7e4-4df9-88c8-6ba88563210f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f', 'volume_size': 1, 'image_id': 'eb9d1452-5bff-4917-96fa-35cafc5b4d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb9d1452-5bff-4917-96fa-35cafc5b4d6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd838f181a4d280fe1ac6a9f7eb8b4839', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '559ec053fd5743a7bcd647c94572058e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ed78300b04e8ad891a542f375f7966e71e148ee9b46df117cd04326b5668f9cea7d17b39b48a7d16ff8f031971eaf570dd084c0d2e6ef0ef9399f0a2bf7e92b', 'id': 'eb9d1452-5bff-4917-96fa-35cafc5b4d6d', 'created_at': datetime.datetime(2026, 6, 19, 2, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 29, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb9d1452-5bff-4917-96fa-35cafc5b4d6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 19 04:29:27 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Trying to clone 25f54ea2-c7e4-4df9-88c8-6ba88563210f from image eb9d1452-5bff-4917-96fa-35cafc5b4d6d at location (None, [{'url': 'file:///opt/stack/data/glance/images/eb9d1452-5bff-4917-96fa-35cafc5b4d6d', 'metadata': {}}]). {{(pid=93300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:29:28 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:29:28 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Image download 0.00 MB at 0.00 MB/s Jun 19 04:29:28 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6a5d0a-7de2-4900-becc-e5b2d5970d91]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:28 devstack sudo[109976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD Jun 19 04:29:28 devstack sudo[109976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:28 devstack sudo[109976]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:28 devstack sudo[109980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD Jun 19 04:29:28 devstack sudo[109980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:29 devstack sudo[109980]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD" returned: 1 in 0.706s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:29:29 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Temporary image eb9d1452-5bff-4917-96fa-35cafc5b4d6d is fetched for user a21778fd6a9b4e0aa4939fa18884c721. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:29:29 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ef5492-a603-49d6-91b4-267dbe3ef2b2]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:29 devstack sudo[109986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD Jun 19 04:29:29 devstack sudo[109986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:30 devstack sudo[109986]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:30 devstack sudo[109990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD Jun 19 04:29:30 devstack sudo[109990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:31 devstack sudo[109990]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD" returned: 1 in 0.745s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:29:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f54ea2-c7e4-4df9-88c8-6ba88563210f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559ec053fd5743a7bcd647c94572058e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:28Z,use_quota=True,user_id='a21778fd6a9b4e0aa4939fa18884c721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3da82ed6-59ce-4f32-aa74-67c4b6d97625),volume_type_id=3da82ed6-59ce-4f32-aa74-67c4b6d97625)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:29:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Creating volume 25f54ea2-c7e4-4df9-88c8-6ba88563210f {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:29:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:29:31 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:29:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:31 devstack sudo[109996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f 1073741824 Jun 19 04:29:31 devstack sudo[109996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:32 devstack sudo[109996]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f 1073741824" returned: 0 in 0.948s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:32 devstack sudo[110002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f Jun 19 04:29:32 devstack sudo[110002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:32 devstack sudo[110002]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f" returned: 0 in 0.645s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:32 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:29:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:32 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Attempting download of eb9d1452-5bff-4917-96fa-35cafc5b4d6d ((None, [{'url': 'file:///opt/stack/data/glance/images/eb9d1452-5bff-4917-96fa-35cafc5b4d6d', 'metadata': {}}])) to volume 25f54ea2-c7e4-4df9-88c8-6ba88563210f. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:29:32 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[890e1a06-4134-4015-aaf5-aa78504ba6bb]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_ujoz9ovj {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:32 devstack sudo[110006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_ujoz9ovj Jun 19 04:29:32 devstack sudo[110006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:33 devstack sudo[110006]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_ujoz9ovj" returned: 0 in 0.729s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_ujoz9ovj {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:33 devstack sudo[110010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_ujoz9ovj Jun 19 04:29:33 devstack sudo[110010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:34 devstack sudo[110010]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_ujoz9ovj" returned: 1 in 0.740s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_ujoz9ovj' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:29:34 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f9945e-cde4-49a1-8584-e9e4027b42f7]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:34 devstack sudo[110014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD Jun 19 04:29:34 devstack sudo[110014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:35 devstack sudo[110014]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:35 devstack sudo[110019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD Jun 19 04:29:35 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:35 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD" returned: 1 in 0.810s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:29:35 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] eb9d1452-5bff-4917-96fa-35cafc5b4d6d was raw, converting to raw {{(pid=93300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:29:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:35 devstack sudo[110024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f Jun 19 04:29:35 devstack sudo[110024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:36 devstack sudo[110024]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f" returned: 0 in 0.770s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:36 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eb9d1452-5bff-4917-96fa-35cafc5b4d6d_6_0i4fzjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:29:36 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Converted 0.00 MB image at 0.00 MB/s Jun 19 04:29:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:36 devstack sudo[110030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f 1G Jun 19 04:29:36 devstack sudo[110030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:37 devstack sudo[110030]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f 1G" returned: 0 in 0.766s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:37 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbeae54-9cb9-4daf-be64-edf48f6ea9fb]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:37 devstack sudo[110035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f Jun 19 04:29:37 devstack sudo[110035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:38 devstack sudo[110035]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f" returned: 0 in 0.786s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:38 devstack sudo[110039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f Jun 19 04:29:38 devstack sudo[110039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:39 devstack sudo[110039]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f" returned: 1 in 0.755s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Downloaded image eb9d1452-5bff-4917-96fa-35cafc5b4d6d ((None, [{'url': 'file:///opt/stack/data/glance/images/eb9d1452-5bff-4917-96fa-35cafc5b4d6d', 'metadata': {}}])) to volume 25f54ea2-c7e4-4df9-88c8-6ba88563210f successfully. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Temporary image eb9d1452-5bff-4917-96fa-35cafc5b4d6d for user a21778fd6a9b4e0aa4939fa18884c721 is deleted. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Marking volume 25f54ea2-c7e4-4df9-88c8-6ba88563210f as bootable. {{(pid=93300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Copying metadata from image eb9d1452-5bff-4917-96fa-35cafc5b4d6d to 25f54ea2-c7e4-4df9-88c8-6ba88563210f. {{(pid=93300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Creating volume glance metadata for volume 25f54ea2-c7e4-4df9-88c8-6ba88563210f backed by image eb9d1452-5bff-4917-96fa-35cafc5b4d6d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'eb9d1452-5bff-4917-96fa-35cafc5b4d6d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd838f181a4d280fe1ac6a9f7eb8b4839', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd31e698-036e-48a3-81fb-16fc9f708046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f', 'volume_size': 1, 'image_id': 'eb9d1452-5bff-4917-96fa-35cafc5b4d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb9d1452-5bff-4917-96fa-35cafc5b4d6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd838f181a4d280fe1ac6a9f7eb8b4839', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '559ec053fd5743a7bcd647c94572058e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ed78300b04e8ad891a542f375f7966e71e148ee9b46df117cd04326b5668f9cea7d17b39b48a7d16ff8f031971eaf570dd084c0d2e6ef0ef9399f0a2bf7e92b', 'id': 'eb9d1452-5bff-4917-96fa-35cafc5b4d6d', 'created_at': datetime.datetime(2026, 6, 19, 2, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 29, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb9d1452-5bff-4917-96fa-35cafc5b4d6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8936927a-6ae2-47d5-92c6-e35bb586af94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:39 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Volume volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f (25f54ea2-c7e4-4df9-88c8-6ba88563210f): created successfully Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8936927a-6ae2-47d5-92c6-e35bb586af94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Flow 'volume_create_manager' (7182837f-2bc7-4486-8f53-3eb32e7e6b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:39 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-bd218131-55ea-49ab-b87d-80448628e32d tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Created volume successfully. Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Acquiring lock "cinder-25f54ea2-c7e4-4df9-88c8-6ba88563210f-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Lock "cinder-25f54ea2-c7e4-4df9-88c8-6ba88563210f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Acquiring lock "cinder-quobyte-25f54ea2-c7e4-4df9-88c8-6ba88563210f" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Lock "cinder-quobyte-25f54ea2-c7e4-4df9-88c8-6ba88563210f" acquired by "delete_volume" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bbcc77-22eb-4c21-a43f-2ead4ce17af9]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:39 devstack sudo[110044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f Jun 19 04:29:39 devstack sudo[110044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:40 devstack sudo[110044]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f" returned: 0 in 0.842s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:40 devstack sudo[110049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f Jun 19 04:29:40 devstack sudo[110049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:41 devstack sudo[110049]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f" returned: 1 in 0.797s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:29:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:41 devstack sudo[110054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f Jun 19 04:29:41 devstack sudo[110054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:41 devstack sudo[110054]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-25f54ea2-c7e4-4df9-88c8-6ba88563210f" returned: 0 in 0.730s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Lock "cinder-quobyte-25f54ea2-c7e4-4df9-88c8-6ba88563210f" released by "delete_volume" :: held 2.438s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:41 devstack cinder-volume[93300]: WARNING cinder.quota [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:29:41 devstack cinder-volume[93300]: WARNING cinder.quota [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:29:41 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Created reservations ['7365dad6-21f2-484c-a46f-fbd26f7f7c5e', '1cac71fb-2b6d-499b-be30-98d4c4949cbb', 'e63c23c9-018c-4e45-8ee9-c5720f4a7ae7', '331c68ba-eed6-4aea-8647-401cbcbefa1b'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:41 devstack sudo[110093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:29:41 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:42 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.628s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:42 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:42 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Deleted volume successfully. Jun 19 04:29:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-cc38fc78-33b9-4fd7-93a4-e9b7752fb99c tempest-VolumeAndVolumeTypeFromImageTest-1927707996 None] Lock "cinder-25f54ea2-c7e4-4df9-88c8-6ba88563210f-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Flow 'volume_create_manager' (38db2d13-d237-4a4f-a82e-2485d7027a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95914f5c-88df-4250-b651-a4366a796caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95914f5c-88df-4250-b651-a4366a796caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1563621953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfbaf94-0d4a-4155-878a-62a7ea5aff87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc7d5fe648940b09932c3e10d8fd54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:49Z,use_quota=True,user_id='9ccdee69dff941df848e22b794eb3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f2ba7d-5f34-4252-b631-f76b618de3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f2ba7d-5f34-4252-b631-f76b618de3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d64ee4-ba63-4e6a-864b-d07b89c48c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d64ee4-ba63-4e6a-864b-d07b89c48c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cfbaf94-0d4a-4155-878a-62a7ea5aff87', 'volume_name': 'volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d15be1-56ba-40fe-b9a5-46ed7403beea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d15be1-56ba-40fe-b9a5-46ed7403beea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16be664a-2ba5-40c8-a6f8-04f7ee50daa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:49 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Volume 4cfbaf94-0d4a-4155-878a-62a7ea5aff87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87', 'volume_size': 1} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1563621953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfbaf94-0d4a-4155-878a-62a7ea5aff87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc7d5fe648940b09932c3e10d8fd54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:49Z,use_quota=True,user_id='9ccdee69dff941df848e22b794eb3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Creating volume 4cfbaf94-0d4a-4155-878a-62a7ea5aff87 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:29:49 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:49 devstack sudo[110097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87 1073741824 Jun 19 04:29:49 devstack sudo[110097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:29:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Flow 'volume_create_manager' (79d5034e-96cb-4293-b245-c085e2b65b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f386511-d148-4452-8d18-45d8e15a7a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f386511-d148-4452-8d18-45d8e15a7a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1773868137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81d144d-fe95-46d8-8be5-99b94cec8c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc7d5fe648940b09932c3e10d8fd54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:50Z,use_quota=True,user_id='9ccdee69dff941df848e22b794eb3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc9ea6b-5c89-4444-bd7a-d54a53a4d703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc9ea6b-5c89-4444-bd7a-d54a53a4d703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c390d1-27be-4cac-bc6d-cda2add687e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c390d1-27be-4cac-bc6d-cda2add687e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd81d144d-fe95-46d8-8be5-99b94cec8c20', 'volume_name': 'volume-d81d144d-fe95-46d8-8be5-99b94cec8c20', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7325d3a1-0244-4ba9-b510-142b72f882da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7325d3a1-0244-4ba9-b510-142b72f882da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbdaa6d-0a8a-4aac-814f-242dc6bc240b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Volume d81d144d-fe95-46d8-8be5-99b94cec8c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d81d144d-fe95-46d8-8be5-99b94cec8c20', 'volume_size': 1} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Flow 'volume_create_manager' (2c865afd-3b95-4fb7-9bb0-3c1500c2e554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f457c3a-9bc8-4306-ae23-83dd4f73eb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f457c3a-9bc8-4306-ae23-83dd4f73eb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1264421279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9785e136-e7e3-4a42-ae91-8af3c4b1d69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc7d5fe648940b09932c3e10d8fd54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:50Z,use_quota=True,user_id='9ccdee69dff941df848e22b794eb3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6764bf76-fa98-432d-baff-3a342028a8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6764bf76-fa98-432d-baff-3a342028a8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66eb1b65-77ef-4b5d-9ae2-662fe504a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66eb1b65-77ef-4b5d-9ae2-662fe504a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9785e136-e7e3-4a42-ae91-8af3c4b1d69b', 'volume_name': 'volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8962d9e1-cf44-42ff-b102-880de4ed3f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8962d9e1-cf44-42ff-b102-880de4ed3f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b22a030-ab84-4311-b86a-aa04c6516fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Volume 9785e136-e7e3-4a42-ae91-8af3c4b1d69b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b', 'volume_size': 1} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:50 devstack sudo[110097]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87 1073741824" returned: 0 in 1.133s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:50 devstack sudo[110103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87 Jun 19 04:29:50 devstack sudo[110103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Flow 'volume_create_manager' (4b31202f-22ec-481f-ac85-47d979dc0279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98a2360-5835-4d76-8e08-77356a77fd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98a2360-5835-4d76-8e08-77356a77fd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1350251938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2888ecdb-7670-4513-8fa7-9ce63090be44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc7d5fe648940b09932c3e10d8fd54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:51Z,use_quota=True,user_id='9ccdee69dff941df848e22b794eb3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1309ed80-c339-47c7-8f6e-9224b74e5493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1309ed80-c339-47c7-8f6e-9224b74e5493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd135bed-85e2-441f-9ec8-758d7a6f6960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd135bed-85e2-441f-9ec8-758d7a6f6960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2888ecdb-7670-4513-8fa7-9ce63090be44', 'volume_name': 'volume-2888ecdb-7670-4513-8fa7-9ce63090be44', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e63a8d1-08c2-430b-9f67-250419289f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e63a8d1-08c2-430b-9f67-250419289f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518e7d8a-2aa6-4a1e-91e9-9192906e6d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:51 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Volume 2888ecdb-7670-4513-8fa7-9ce63090be44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2888ecdb-7670-4513-8fa7-9ce63090be44', 'volume_size': 1} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Flow 'volume_create_manager' (099d8d93-0efc-4af4-ae68-0e548810ecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068aab3f-47c2-4b26-8c5f-8f6eb97e003e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068aab3f-47c2-4b26-8c5f-8f6eb97e003e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99042380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b450682c-dfd4-4d06-8d7e-7976a49ee3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc7d5fe648940b09932c3e10d8fd54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:51Z,use_quota=True,user_id='9ccdee69dff941df848e22b794eb3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27969c84-cdc8-4d61-ab21-4f27a6dc7b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27969c84-cdc8-4d61-ab21-4f27a6dc7b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546455f2-37b5-4da4-800c-5fd99b216547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546455f2-37b5-4da4-800c-5fd99b216547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b450682c-dfd4-4d06-8d7e-7976a49ee3a2', 'volume_name': 'volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d96a0a5-b4c8-48d9-b6b1-f021590f374d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d96a0a5-b4c8-48d9-b6b1-f021590f374d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e9263c-642f-46cb-93d4-5df8c1a9cc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:51 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Volume b450682c-dfd4-4d06-8d7e-7976a49ee3a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2', 'volume_size': 1} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:51 devstack sudo[110103]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87" returned: 0 in 0.781s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.499s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1773868137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81d144d-fe95-46d8-8be5-99b94cec8c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc7d5fe648940b09932c3e10d8fd54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:50Z,use_quota=True,user_id='9ccdee69dff941df848e22b794eb3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Creating volume d81d144d-fe95-46d8-8be5-99b94cec8c20 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:29:51 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d81d144d-fe95-46d8-8be5-99b94cec8c20 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:51 devstack sudo[110106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d81d144d-fe95-46d8-8be5-99b94cec8c20 1073741824 Jun 19 04:29:51 devstack sudo[110106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16be664a-2ba5-40c8-a6f8-04f7ee50daa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c9d7b7-3fb5-43ed-8e86-7ef0032380c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:51 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Volume volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87 (4cfbaf94-0d4a-4155-878a-62a7ea5aff87): created successfully Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c9d7b7-3fb5-43ed-8e86-7ef0032380c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Flow 'volume_create_manager' (38db2d13-d237-4a4f-a82e-2485d7027a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:51 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-024b062a-0a4d-4848-9838-1befd269c43b tempest-CreateVolumesFromImageTest-475229961 None] Created volume successfully. Jun 19 04:29:52 devstack sudo[110106]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d81d144d-fe95-46d8-8be5-99b94cec8c20 1073741824" returned: 0 in 0.903s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d81d144d-fe95-46d8-8be5-99b94cec8c20 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:52 devstack sudo[110112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d81d144d-fe95-46d8-8be5-99b94cec8c20 Jun 19 04:29:52 devstack sudo[110112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:53 devstack sudo[110112]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d81d144d-fe95-46d8-8be5-99b94cec8c20" returned: 0 in 0.665s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.738s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1264421279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9785e136-e7e3-4a42-ae91-8af3c4b1d69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc7d5fe648940b09932c3e10d8fd54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:50Z,use_quota=True,user_id='9ccdee69dff941df848e22b794eb3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Creating volume 9785e136-e7e3-4a42-ae91-8af3c4b1d69b {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:29:53 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbdaa6d-0a8a-4aac-814f-242dc6bc240b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d81d144d-fe95-46d8-8be5-99b94cec8c20', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1962c283-ba2d-4652-9e92-8e36fe1520f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:53 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Volume volume-d81d144d-fe95-46d8-8be5-99b94cec8c20 (d81d144d-fe95-46d8-8be5-99b94cec8c20): created successfully Jun 19 04:29:53 devstack sudo[110115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b 1073741824 Jun 19 04:29:53 devstack sudo[110115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1962c283-ba2d-4652-9e92-8e36fe1520f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Flow 'volume_create_manager' (79d5034e-96cb-4293-b245-c085e2b65b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:53 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-6bf3669d-7942-4eb5-ad8e-623c2a5f817a tempest-CreateVolumesFromImageTest-475229961 None] Created volume successfully. Jun 19 04:29:54 devstack sudo[110115]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b 1073741824" returned: 0 in 1.034s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:54 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=41,cinder:SELECT=38,cinder:INSERT=12,cinder:DELETE=2 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:29:54 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=41,cinder:UPDATE=36,cinder:INSERT=13,cinder:DELETE=4 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:29:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:54 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b Jun 19 04:29:54 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:55 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b" returned: 0 in 0.678s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.013s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1350251938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2888ecdb-7670-4513-8fa7-9ce63090be44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc7d5fe648940b09932c3e10d8fd54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:51Z,use_quota=True,user_id='9ccdee69dff941df848e22b794eb3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Creating volume 2888ecdb-7670-4513-8fa7-9ce63090be44 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:29:55 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2888ecdb-7670-4513-8fa7-9ce63090be44 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:55 devstack sudo[110124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2888ecdb-7670-4513-8fa7-9ce63090be44 1073741824 Jun 19 04:29:55 devstack sudo[110124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b22a030-ab84-4311-b86a-aa04c6516fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94b568c-ae05-41d5-b135-4ae5aa7716a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:55 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Volume volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b (9785e136-e7e3-4a42-ae91-8af3c4b1d69b): created successfully Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94b568c-ae05-41d5-b135-4ae5aa7716a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Flow 'volume_create_manager' (2c865afd-3b95-4fb7-9bb0-3c1500c2e554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:55 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-881243e1-8dcd-4fa3-9b7b-fbb83c33734b tempest-CreateVolumesFromImageTest-475229961 None] Created volume successfully. Jun 19 04:29:56 devstack sudo[110124]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2888ecdb-7670-4513-8fa7-9ce63090be44 1073741824" returned: 0 in 0.963s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2888ecdb-7670-4513-8fa7-9ce63090be44 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:56 devstack sudo[110130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2888ecdb-7670-4513-8fa7-9ce63090be44 Jun 19 04:29:56 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:56 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2888ecdb-7670-4513-8fa7-9ce63090be44" returned: 0 in 0.679s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.384s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99042380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b450682c-dfd4-4d06-8d7e-7976a49ee3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc7d5fe648940b09932c3e10d8fd54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:51Z,use_quota=True,user_id='9ccdee69dff941df848e22b794eb3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Creating volume b450682c-dfd4-4d06-8d7e-7976a49ee3a2 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:29:56 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518e7d8a-2aa6-4a1e-91e9-9192906e6d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2888ecdb-7670-4513-8fa7-9ce63090be44', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:56 devstack sudo[110133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2 1073741824 Jun 19 04:29:56 devstack sudo[110133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb8d0ae-7f9c-4a24-957b-287c98c66d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:56 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Volume volume-2888ecdb-7670-4513-8fa7-9ce63090be44 (2888ecdb-7670-4513-8fa7-9ce63090be44): created successfully Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb8d0ae-7f9c-4a24-957b-287c98c66d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Flow 'volume_create_manager' (4b31202f-22ec-481f-ac85-47d979dc0279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:56 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3d598a72-a569-490e-a8ff-14767c7006d4 tempest-CreateVolumesFromImageTest-475229961 None] Created volume successfully. Jun 19 04:29:57 devstack sudo[110133]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2 1073741824" returned: 0 in 0.845s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:57 devstack sudo[110139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2 Jun 19 04:29:57 devstack sudo[110139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:58 devstack sudo[110139]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2" returned: 0 in 0.687s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:58 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:29:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:58 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e9263c-642f-46cb-93d4-5df8c1a9cc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:58 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835806ee-efe4-41f0-95eb-540388971723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:58 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Volume volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2 (b450682c-dfd4-4d06-8d7e-7976a49ee3a2): created successfully Jun 19 04:29:58 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835806ee-efe4-41f0-95eb-540388971723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:58 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Flow 'volume_create_manager' (099d8d93-0efc-4af4-ae68-0e548810ecd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:58 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d4dd8850-d258-4579-b225-e9526f1ebb04 tempest-CreateVolumesFromImageTest-475229961 None] Created volume successfully. Jun 19 04:29:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "cinder-b450682c-dfd4-4d06-8d7e-7976a49ee3a2-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-b450682c-dfd4-4d06-8d7e-7976a49ee3a2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "cinder-quobyte-b450682c-dfd4-4d06-8d7e-7976a49ee3a2" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-quobyte-b450682c-dfd4-4d06-8d7e-7976a49ee3a2" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:59 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[77402c03-05fe-4134-a89c-269cd06ae2a7]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:59 devstack sudo[110142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2 Jun 19 04:29:59 devstack sudo[110142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:59 devstack sudo[110142]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2" returned: 0 in 0.799s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:59 devstack sudo[110148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2 Jun 19 04:29:59 devstack sudo[110148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Flow 'volume_create_manager' (534a40fe-77d7-48d9-a2db-6eef02cecdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a792eb39-d075-42e4-b882-fcdecc1529eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a792eb39-d075-42e4-b882-fcdecc1529eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2139460805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ac5fa2f6074d0db4437bba4289c51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:00Z,use_quota=True,user_id='8e826b792c5c4a7396ebe21fd2865ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c661711-92e0-4d18-aad3-5a41029b5afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c661711-92e0-4d18-aad3-5a41029b5afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff34f61c-dbc7-48aa-bf43-500ac03ca053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff34f61c-dbc7-48aa-bf43-500ac03ca053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b', 'volume_name': 'volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563048e6-d19b-4f87-ab4c-65bfe70d4f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563048e6-d19b-4f87-ab4c-65bfe70d4f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04aa2274-8e80-4df5-941c-a3ecc4a5d2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:00 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Volume 4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b', 'volume_size': 1} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2139460805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ac5fa2f6074d0db4437bba4289c51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:00Z,use_quota=True,user_id='8e826b792c5c4a7396ebe21fd2865ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Creating volume 4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:30:00 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:00 devstack sudo[110150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b 1073741824 Jun 19 04:30:00 devstack sudo[110150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Flow 'volume_create_manager' (5843382f-3b50-4179-b791-50f547dc916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c868e30d-75c7-4c49-af77-111818707291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c868e30d-75c7-4c49-af77-111818707291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-815048368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248b3546-cccb-4db9-b558-fb82b6b99d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ac5fa2f6074d0db4437bba4289c51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:00Z,use_quota=True,user_id='8e826b792c5c4a7396ebe21fd2865ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3a82b1-f9ab-4777-b91d-f541e4d847c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3a82b1-f9ab-4777-b91d-f541e4d847c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1b5135-bcda-4d7e-bd6b-f8cb16d1b6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1b5135-bcda-4d7e-bd6b-f8cb16d1b6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '248b3546-cccb-4db9-b558-fb82b6b99d7b', 'volume_name': 'volume-248b3546-cccb-4db9-b558-fb82b6b99d7b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895b6ece-996c-4f1d-8731-e78937ec2dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895b6ece-996c-4f1d-8731-e78937ec2dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb9612c-573f-4a18-9787-d955d1941892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:00 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Volume 248b3546-cccb-4db9-b558-fb82b6b99d7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-248b3546-cccb-4db9-b558-fb82b6b99d7b', 'volume_size': 1} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:00 devstack sudo[110148]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b450682c-dfd4-4d06-8d7e-7976a49ee3a2" returned: 0 in 0.824s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-quobyte-b450682c-dfd4-4d06-8d7e-7976a49ee3a2" released by "delete_volume" :: held 1.674s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Created reservations ['9fd62d09-04b0-4401-acc3-7d378f6990a0', 'bec43ee0-7e25-4bb4-96bf-319a913cce8e', 'be7c4371-048d-4ac6-a033-56a71d5a4cc4', '74c27234-b8d8-4542-99dd-2be5d1f25aa0'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:00 devstack sudo[110156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:30:00 devstack sudo[110156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:01 devstack sudo[110150]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b 1073741824" returned: 0 in 1.070s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:01 devstack sudo[110159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b Jun 19 04:30:01 devstack sudo[110159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "cinder-2888ecdb-7670-4513-8fa7-9ce63090be44-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-2888ecdb-7670-4513-8fa7-9ce63090be44-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "cinder-quobyte-2888ecdb-7670-4513-8fa7-9ce63090be44" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-quobyte-2888ecdb-7670-4513-8fa7-9ce63090be44" acquired by "delete_volume" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:01 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be8ab40-dd9c-4005-8994-e3266fcce358]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2888ecdb-7670-4513-8fa7-9ce63090be44 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:01 devstack sudo[110161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2888ecdb-7670-4513-8fa7-9ce63090be44 Jun 19 04:30:01 devstack sudo[110161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:01 devstack sudo[110156]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.832s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:01 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:01 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Deleted volume successfully. Jun 19 04:30:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-19134805-89e7-450d-9841-7fea620aef65 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-b450682c-dfd4-4d06-8d7e-7976a49ee3a2-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:02 devstack sudo[110159]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b" returned: 0 in 0.857s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.985s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-815048368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248b3546-cccb-4db9-b558-fb82b6b99d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ac5fa2f6074d0db4437bba4289c51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:00Z,use_quota=True,user_id='8e826b792c5c4a7396ebe21fd2865ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Creating volume 248b3546-cccb-4db9-b558-fb82b6b99d7b {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:30:02 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:02 devstack sudo[110165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b 1073741824 Jun 19 04:30:02 devstack sudo[110165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04aa2274-8e80-4df5-941c-a3ecc4a5d2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dc8dbd-67fe-4545-ba3d-c4159b4d9542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:02 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Volume volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b (4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b): created successfully Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dc8dbd-67fe-4545-ba3d-c4159b4d9542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Flow 'volume_create_manager' (534a40fe-77d7-48d9-a2db-6eef02cecdb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:02 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3da687a8-8bf3-4847-96f9-75151954e95a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Created volume successfully. Jun 19 04:30:02 devstack sudo[110161]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2888ecdb-7670-4513-8fa7-9ce63090be44" returned: 0 in 0.917s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2888ecdb-7670-4513-8fa7-9ce63090be44 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:02 devstack sudo[110170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2888ecdb-7670-4513-8fa7-9ce63090be44 Jun 19 04:30:02 devstack sudo[110170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:03 devstack sudo[110165]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b 1073741824" returned: 0 in 0.933s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:03 devstack sudo[110177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b Jun 19 04:30:03 devstack sudo[110177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:03 devstack sudo[110170]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2888ecdb-7670-4513-8fa7-9ce63090be44" returned: 0 in 0.730s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-quobyte-2888ecdb-7670-4513-8fa7-9ce63090be44" released by "delete_volume" :: held 1.715s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Created reservations ['519668ed-981b-4adf-ba71-fe5c375971f4', '6cd317cd-7b24-4eff-8c3b-37905c051472', '363e2cda-a080-4298-9654-c356708e1dba', '9995049a-1cd9-49d6-a42d-3800d773d749'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:03 devstack sudo[110179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:30:03 devstack sudo[110179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "cinder-9785e136-e7e3-4a42-ae91-8af3c4b1d69b-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-9785e136-e7e3-4a42-ae91-8af3c4b1d69b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "cinder-quobyte-9785e136-e7e3-4a42-ae91-8af3c4b1d69b" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-quobyte-9785e136-e7e3-4a42-ae91-8af3c4b1d69b" acquired by "delete_volume" :: waited 0.029s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b292ce1-0ef6-4906-91bb-bb681ad37e2f]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:03 devstack sudo[110185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b Jun 19 04:30:03 devstack sudo[110185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:04 devstack sudo[110177]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b" returned: 0 in 0.979s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:30:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb9612c-573f-4a18-9787-d955d1941892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-248b3546-cccb-4db9-b558-fb82b6b99d7b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb172a07-f44c-4bb6-b3f2-1e453dbd086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:04 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Volume volume-248b3546-cccb-4db9-b558-fb82b6b99d7b (248b3546-cccb-4db9-b558-fb82b6b99d7b): created successfully Jun 19 04:30:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb172a07-f44c-4bb6-b3f2-1e453dbd086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:04 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Flow 'volume_create_manager' (5843382f-3b50-4179-b791-50f547dc916a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:04 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-89974e0b-ed63-4bfd-9948-34070aa9a6dd tempest-TestServerVolumeAttachmentScenario-1419127608 None] Created volume successfully. Jun 19 04:30:04 devstack sudo[110179]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.014s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:04 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:04 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Deleted volume successfully. Jun 19 04:30:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e420fad5-0286-4dc3-b1a9-d77106789772 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-2888ecdb-7670-4513-8fa7-9ce63090be44-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:04 devstack sudo[110185]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b" returned: 0 in 0.934s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:04 devstack sudo[110194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b Jun 19 04:30:04 devstack sudo[110194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:05 devstack sudo[110194]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9785e136-e7e3-4a42-ae91-8af3c4b1d69b" returned: 0 in 0.631s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-quobyte-9785e136-e7e3-4a42-ae91-8af3c4b1d69b" released by "delete_volume" :: held 1.637s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:05 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Created reservations ['0b9f4580-bc84-4fdc-a16f-351deef05371', 'a3d090c9-3a43-41b4-a43c-927ab1ea1b5e', '106d3936-d140-4c6c-b6b0-d6ff9a15f28b', 'f3f3371c-470a-43fd-ae5d-2b0e9990731f'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:05 devstack sudo[110198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:30:05 devstack sudo[110198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "cinder-d81d144d-fe95-46d8-8be5-99b94cec8c20-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-d81d144d-fe95-46d8-8be5-99b94cec8c20-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "cinder-quobyte-d81d144d-fe95-46d8-8be5-99b94cec8c20" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-quobyte-d81d144d-fe95-46d8-8be5-99b94cec8c20" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:06 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d859d5-07a3-4f66-a5c4-7381b26025b8]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d81d144d-fe95-46d8-8be5-99b94cec8c20 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:06 devstack sudo[110207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d81d144d-fe95-46d8-8be5-99b94cec8c20 Jun 19 04:30:06 devstack sudo[110207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:06 devstack sudo[110198]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.668s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:06 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:06 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Deleted volume successfully. Jun 19 04:30:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-44e6dbe9-11c6-4052-8a04-38d2825fa027 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-9785e136-e7e3-4a42-ae91-8af3c4b1d69b-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:06 devstack sudo[110207]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d81d144d-fe95-46d8-8be5-99b94cec8c20" returned: 0 in 0.732s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d81d144d-fe95-46d8-8be5-99b94cec8c20 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:06 devstack sudo[110213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d81d144d-fe95-46d8-8be5-99b94cec8c20 Jun 19 04:30:06 devstack sudo[110213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:07 devstack sudo[110213]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d81d144d-fe95-46d8-8be5-99b94cec8c20" returned: 0 in 0.627s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-quobyte-d81d144d-fe95-46d8-8be5-99b94cec8c20" released by "delete_volume" :: held 1.394s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:07 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Created reservations ['b01dd9bf-c2a0-43a0-aa82-844c294b9d3e', '4bc4ee79-daae-4f82-a16b-30c804a06455', '91775dde-a5a7-48d1-b6d6-ed4b164890bb', '21b58466-623a-4121-8d8c-cdcd05ff302e'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:07 devstack sudo[110216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:30:07 devstack sudo[110216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:08 devstack sudo[110216]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.650s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:08 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:08 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Deleted volume successfully. Jun 19 04:30:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-68939d34-5dba-4b80-b8de-0908a887bb29 tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-d81d144d-fe95-46d8-8be5-99b94cec8c20-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "cinder-4cfbaf94-0d4a-4155-878a-62a7ea5aff87-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-4cfbaf94-0d4a-4155-878a-62a7ea5aff87-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "cinder-quobyte-4cfbaf94-0d4a-4155-878a-62a7ea5aff87" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:08 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-quobyte-4cfbaf94-0d4a-4155-878a-62a7ea5aff87" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:08 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[412b95f2-122b-4f2d-9068-2bc702c8879b]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:08 devstack sudo[110219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87 Jun 19 04:30:08 devstack sudo[110219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:09 devstack sudo[110219]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87" returned: 0 in 0.943s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:09 devstack sudo[110238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87 Jun 19 04:30:09 devstack sudo[110238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:09 devstack sudo[110238]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4cfbaf94-0d4a-4155-878a-62a7ea5aff87" returned: 0 in 0.703s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-quobyte-4cfbaf94-0d4a-4155-878a-62a7ea5aff87" released by "delete_volume" :: held 1.697s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:10 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Created reservations ['f5df9418-96a2-49b5-b91b-67743dcca59f', '6806f69c-644d-43d3-ac4a-507eccc53183', '598489dc-8668-4f94-91ba-981d92578af7', 'a3777eb9-d159-41a0-b206-3b7c76a2043c'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:10 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:10 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:10 devstack sudo[110244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:30:10 devstack sudo[110244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:10 devstack sudo[110244]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.764s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:10 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:10 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Deleted volume successfully. Jun 19 04:30:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1490ef2d-9736-4a9a-8b88-3eb8a4c90e6b tempest-CreateVolumesFromImageTest-475229961 None] Lock "cinder-4cfbaf94-0d4a-4155-878a-62a7ea5aff87-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:30:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:19 devstack sudo[110350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:30:19 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:20 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=34,cinder:INSERT=14,cinder:UPDATE=55,cinder:DELETE=4 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:30:20 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.016s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:20 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:30:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 29 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:30:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:30:20 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=51,cinder:SELECT=29,cinder:DELETE=6,cinder:INSERT=11 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Flow 'volume_create_manager' (ba2881ce-2fba-4820-a508-27c959f4432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e06fcb-43b6-46c0-b690-2b4ef85cf589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e06fcb-43b6-46c0-b690-2b4ef85cf589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1877073864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84aff80b-676c-4689-8db9-f6083797a581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789c55e7fc2f41c88777b8db2fc43eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:33Z,use_quota=True,user_id='fff564498ec34549a7fdd4cd0554123b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4371ff-f8f6-46c5-b083-1815181858da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4371ff-f8f6-46c5-b083-1815181858da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87c5356-2ad6-40d3-aeb4-39d3739e466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87c5356-2ad6-40d3-aeb4-39d3739e466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84aff80b-676c-4689-8db9-f6083797a581', 'volume_name': 'volume-84aff80b-676c-4689-8db9-f6083797a581', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edd8b15-5a9e-49ea-94cb-62eafefc83dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edd8b15-5a9e-49ea-94cb-62eafefc83dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f5517a-0886-40a4-b784-24099108d417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:33 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Volume 84aff80b-676c-4689-8db9-f6083797a581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84aff80b-676c-4689-8db9-f6083797a581', 'volume_size': 1} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1877073864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84aff80b-676c-4689-8db9-f6083797a581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789c55e7fc2f41c88777b8db2fc43eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:33Z,use_quota=True,user_id='fff564498ec34549a7fdd4cd0554123b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Creating volume 84aff80b-676c-4689-8db9-f6083797a581 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:30:33 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:33 devstack sudo[110390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 1073741824 Jun 19 04:30:33 devstack sudo[110390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:33 devstack sudo[110390]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 1073741824" returned: 0 in 0.801s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:33 devstack sudo[110395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 Jun 19 04:30:33 devstack sudo[110395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:34 devstack sudo[110395]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581" returned: 0 in 0.639s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:30:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f5517a-0886-40a4-b784-24099108d417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84aff80b-676c-4689-8db9-f6083797a581', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdec0041-9038-415e-a63a-eb30ef5403c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:34 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Volume volume-84aff80b-676c-4689-8db9-f6083797a581 (84aff80b-676c-4689-8db9-f6083797a581): created successfully Jun 19 04:30:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdec0041-9038-415e-a63a-eb30ef5403c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Flow 'volume_create_manager' (ba2881ce-2fba-4820-a508-27c959f4432f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:34 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-96e9a44d-28c3-4b62-87d6-e1bb8430d0e5 tempest-SnapshotDependencyTests-587246041 None] Created volume successfully. Jun 19 04:30:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] Creating offline snapshot 2b997789-2dd5-487e-97b0-8c4ded585493 of volume 84aff80b-676c-4689-8db9-f6083797a581 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:30:35 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1886cc96-67e0-45c5-814a-b6c17c4b93ed]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:35 devstack sudo[110398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 Jun 19 04:30:35 devstack sudo[110398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581" returned: 0 in 0.767s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:36 devstack sudo[110398]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:36 devstack sudo[110403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 1G Jun 19 04:30:36 devstack sudo[110403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:36 devstack sudo[110403]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 1G" returned: 0 in 0.794s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84aff80b-676c-4689-8db9-f6083797a581 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:36 devstack sudo[110408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84aff80b-676c-4689-8db9-f6083797a581 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 Jun 19 04:30:36 devstack sudo[110408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:37 devstack sudo[110408]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84aff80b-676c-4689-8db9-f6083797a581 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493" returned: 0 in 0.660s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:37 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 is being set with open permissions: ugo+rw Jun 19 04:30:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:37 devstack sudo[110413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 Jun 19 04:30:37 devstack sudo[110413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:38 devstack sudo[110413]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493" returned: 0 in 0.628s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:38 devstack sudo[110416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.info Jun 19 04:30:38 devstack sudo[110416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:38 devstack sudo[110416]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.info" returned: 0 in 0.690s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:38 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.info is being set with open permissions: ugo+rw Jun 19 04:30:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:38 devstack sudo[110419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.info Jun 19 04:30:38 devstack sudo[110419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:39 devstack sudo[110419]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.info" returned: 0 in 0.612s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.234s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:39 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-36a5c321-dfd2-4629-a63d-afdf81357faf tempest-SnapshotDependencyTests-587246041 None] Create snapshot completed successfully Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Flow 'volume_create_manager' (371435c7-15b1-49f7-b746-d46008a7f174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737a4160-9cbf-402a-8e51-c9428150250f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737a4160-9cbf-402a-8e51-c9428150250f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f6de5e-51c6-48e8-b14e-2cf14b96ae6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789c55e7fc2f41c88777b8db2fc43eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2b997789-2dd5-487e-97b0-8c4ded585493,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:41Z,use_quota=True,user_id='fff564498ec34549a7fdd4cd0554123b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2a2297-0bfc-4038-96b5-8b7df3b5c505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2a2297-0bfc-4038-96b5-8b7df3b5c505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c1a91b-23ba-4793-ae10-dd33ff2bc22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c1a91b-23ba-4793-ae10-dd33ff2bc22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68f6de5e-51c6-48e8-b14e-2cf14b96ae6d', 'volume_name': 'volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d', 'volume_size': 1, 'snapshot_id': '2b997789-2dd5-487e-97b0-8c4ded585493'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88445471-dadf-4fdc-bb5d-144b10056087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88445471-dadf-4fdc-bb5d-144b10056087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012ea35d-f741-4c34-83e4-bc4c7b3ef981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:41 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Volume 68f6de5e-51c6-48e8-b14e-2cf14b96ae6d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d', 'volume_size': 1, 'snapshot_id': '2b997789-2dd5-487e-97b0-8c4ded585493'} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "cinder-quobyte-2b997789-2dd5-487e-97b0-8c4ded585493-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d" by "_create_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-quobyte-2b997789-2dd5-487e-97b0-8c4ded585493-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Creating volume 68f6de5e-51c6-48e8-b14e-2cf14b96ae6d from snapshot 2b997789-2dd5-487e-97b0-8c4ded585493 {{(pid=93300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "cinder-quobyte-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d" by "_copy_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-quobyte-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] snapshot: 2b997789-2dd5-487e-97b0-8c4ded585493, volume: 68f6de5e-51c6-48e8-b14e-2cf14b96ae6d, {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a86193-b4ce-4f5c-8b0c-8cfe24e1afd8]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:41 devstack sudo[110423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 Jun 19 04:30:41 devstack sudo[110423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:42 devstack sudo[110423]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493" returned: 0 in 0.811s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84aff80b-676c-4689-8db9-f6083797a581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:30:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:30:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Creating direct copy from snapshot {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:30:42 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa416d2-5ad5-4c16-9988-1e5d51cdce69]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:42 devstack sudo[110464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 Jun 19 04:30:42 devstack sudo[110464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:42 devstack sudo[110464]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581" returned: 0 in 0.750s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:42 devstack cinder-volume[93300]: DEBUG cinder.utils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Path /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d not found in is_blk_device check {{(pid=93300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:30:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:42 devstack sudo[110469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d Jun 19 04:30:42 devstack sudo[110469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:47 devstack sudo[110469]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d" returned: 0 in 4.730s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:47 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12a54f2-140d-4163-ba54-c9f7db5856d0]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:47 devstack sudo[110487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 Jun 19 04:30:47 devstack sudo[110487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-daf20be3-bf93-41fa-ad3d-04cc28d7ed4d req-c5ac18a8-f6b4-4cc6-93fc-1bc936a92ae7 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:48 devstack sudo[110487]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581" returned: 0 in 0.965s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:48 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581, size 1024.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:30:48 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Converted 1024.00 MB image at 216.44 MB/s Jun 19 04:30:48 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d is being set with open permissions: ugo+rw Jun 19 04:30:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:48 devstack sudo[110500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d Jun 19 04:30:48 devstack sudo[110500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:49 devstack sudo[110500]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d" returned: 0 in 0.634s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-quobyte-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d" released by "_copy_volume_from_snapshot" :: held 7.982s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-quobyte-2b997789-2dd5-487e-97b0-8c4ded585493-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d" released by "_create_volume_from_snapshot" :: held 8.009s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.023s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-daf20be3-bf93-41fa-ad3d-04cc28d7ed4d req-c5ac18a8-f6b4-4cc6-93fc-1bc936a92ae7 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.760s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d244424f-d641-459e-9810-4cffa89ab9e0]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-daf20be3-bf93-41fa-ad3d-04cc28d7ed4d req-c5ac18a8-f6b4-4cc6-93fc-1bc936a92ae7 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012ea35d-f741-4c34-83e4-bc4c7b3ef981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d', 'volume_size': 1, 'snapshot_id': '2b997789-2dd5-487e-97b0-8c4ded585493'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0abe97-d5de-47a4-80ab-9ecc1d3beaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:49 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Volume volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d (68f6de5e-51c6-48e8-b14e-2cf14b96ae6d): created successfully Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0abe97-d5de-47a4-80ab-9ecc1d3beaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Flow 'volume_create_manager' (371435c7-15b1-49f7-b746-d46008a7f174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:49 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-17339dd9-f9dc-420a-9274-388b8ab55f5e tempest-SnapshotDependencyTests-587246041 None] Created volume successfully. Jun 19 04:30:49 devstack sudo[110503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b Jun 19 04:30:49 devstack sudo[110503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "cinder-2b997789-2dd5-487e-97b0-8c4ded585493-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-2b997789-2dd5-487e-97b0-8c4ded585493-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "cinder-quobyte-84aff80b-676c-4689-8db9-f6083797a581" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-quobyte-84aff80b-676c-4689-8db9-f6083797a581" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "cinder-quobyte-2b997789-2dd5-487e-97b0-8c4ded585493" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-quobyte-2b997789-2dd5-487e-97b0-8c4ded585493" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Deleting offline snapshot 2b997789-2dd5-487e-97b0-8c4ded585493 of volume 84aff80b-676c-4689-8db9-f6083797a581 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:30:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] snapshot_file for this snap is: volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:30:50 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f579df-c134-4206-8443-b618f23b69d8]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:50 devstack sudo[110503]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-daf20be3-bf93-41fa-ad3d-04cc28d7ed4d req-c5ac18a8-f6b4-4cc6-93fc-1bc936a92ae7 tempest-TestServerVolumeAttachmentScenario-1419127608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b" returned: 0 in 0.804s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-daf20be3-bf93-41fa-ad3d-04cc28d7ed4d req-c5ac18a8-f6b4-4cc6-93fc-1bc936a92ae7 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.819s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-daf20be3-bf93-41fa-ad3d-04cc28d7ed4d req-c5ac18a8-f6b4-4cc6-93fc-1bc936a92ae7 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfbe0074-4899-4d17-a041-56a246807777', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:30:50 devstack sudo[110509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 Jun 19 04:30:50 devstack sudo[110509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:50 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-daf20be3-bf93-41fa-ad3d-04cc28d7ed4d req-c5ac18a8-f6b4-4cc6-93fc-1bc936a92ae7 tempest-TestServerVolumeAttachmentScenario-1419127608 None] attachment_update completed successfully. Jun 19 04:30:50 devstack sudo[110509]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493" returned: 0 in 0.765s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84aff80b-676c-4689-8db9-f6083797a581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:30:50 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb97de8-873e-4556-bfdf-13317278a639]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:50 devstack sudo[110581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 Jun 19 04:30:50 devstack sudo[110581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:51 devstack sudo[110581]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581" returned: 0 in 0.801s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:51 devstack sudo[110904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 Jun 19 04:30:51 devstack sudo[110904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:52 devstack sudo[110904]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493" returned: 0 in 0.760s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:52 devstack sudo[110910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493 Jun 19 04:30:52 devstack sudo[110910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:53 devstack sudo[110910]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581.2b997789-2dd5-487e-97b0-8c4ded585493" returned: 0 in 0.630s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-quobyte-2b997789-2dd5-487e-97b0-8c4ded585493" released by "_delete_snapshot" :: held 3.055s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-quobyte-84aff80b-676c-4689-8db9-f6083797a581" released by "delete_snapshot" :: held 3.078s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:53 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Created reservations ['ba17caf1-238f-4e50-a3a1-3627b887f774', 'd6abd67e-61d2-4d24-a05d-1bf89d91396d', '9c9a54f0-51ca-46a0-8e40-e5a84f9ce6c7', 'cde4b1c7-f516-4544-bee8-f309e32e44be'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:53 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Delete snapshot completed successfully. Jun 19 04:30:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-088b0b69-17b6-48a3-a526-3debe28566ab tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-2b997789-2dd5-487e-97b0-8c4ded585493-delete_snapshot" released by "delete_snapshot" :: held 3.217s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "cinder-84aff80b-676c-4689-8db9-f6083797a581-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-84aff80b-676c-4689-8db9-f6083797a581-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "cinder-quobyte-84aff80b-676c-4689-8db9-f6083797a581" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-quobyte-84aff80b-676c-4689-8db9-f6083797a581" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:54 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21bf161-a4c9-4458-8835-17d556caa1af]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:54 devstack sudo[110913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 Jun 19 04:30:54 devstack sudo[110913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:55 devstack sudo[110913]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581" returned: 0 in 0.779s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:55 devstack sudo[110918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581 Jun 19 04:30:55 devstack sudo[110918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:55 devstack sudo[110918]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84aff80b-676c-4689-8db9-f6083797a581" returned: 0 in 0.630s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-quobyte-84aff80b-676c-4689-8db9-f6083797a581" released by "delete_volume" :: held 1.479s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:55 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Created reservations ['930bdd6b-76bd-47b0-bbbf-401174fb69a1', '681f6fc4-a047-4f8f-8233-94fef29cee11', '34515752-e6f7-48bc-b90e-d77b9d146475', '813f8b04-32f6-4ef1-9001-c7318b57d5a2'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:55 devstack sudo[110921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:30:55 devstack sudo[110921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "cinder-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "cinder-quobyte-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-quobyte-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d" acquired by "delete_volume" :: waited 0.026s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:56 devstack sudo[110921]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.672s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:56 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:56 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Deleted volume successfully. Jun 19 04:30:56 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcdf3a0-5fb5-4fd3-8f39-651517fece7c]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3500b38c-742c-4add-a25c-b6b4ae86a500 tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-84aff80b-676c-4689-8db9-f6083797a581-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:56 devstack sudo[110924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d Jun 19 04:30:56 devstack sudo[110924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:57 devstack sudo[110924]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d" returned: 0 in 0.768s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:57 devstack sudo[110932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d Jun 19 04:30:57 devstack sudo[110932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:57 devstack sudo[110932]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d" returned: 0 in 0.656s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-quobyte-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d" released by "delete_volume" :: held 1.482s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:58 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Created reservations ['d335b718-008c-4ca9-9315-298dfbeaaff9', '911110b2-d4fe-4b3c-bb21-9b8c494fc273', '4e3386d8-9faa-4b6b-808d-143482c32a0d', '6a969d19-5d9e-485b-a9ea-214523df3afc'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:58 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:58 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:58 devstack sudo[110935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:30:58 devstack sudo[110935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:58 devstack sudo[110935]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.638s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:58 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:58 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Deleted volume successfully. Jun 19 04:30:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c51f66a9-78af-410b-bec9-23ff642a569f tempest-SnapshotDependencyTests-587246041 None] Lock "cinder-68f6de5e-51c6-48e8-b14e-2cf14b96ae6d-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-722bb1ef-87c5-4370-ab34-1c7ce8faf5d7 req-4d37e545-d6f6-4d05-8bc4-df1fbb8d424a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-722bb1ef-87c5-4370-ab34-1c7ce8faf5d7 req-4d37e545-d6f6-4d05-8bc4-df1fbb8d424a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:59 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bdecee-047b-47f9-b02a-1fd3f1d771c4]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-722bb1ef-87c5-4370-ab34-1c7ce8faf5d7 req-4d37e545-d6f6-4d05-8bc4-df1fbb8d424a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:00 devstack sudo[110947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b Jun 19 04:31:00 devstack sudo[110947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:00 devstack sudo[110947]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [req-722bb1ef-87c5-4370-ab34-1c7ce8faf5d7 req-4d37e545-d6f6-4d05-8bc4-df1fbb8d424a tempest-TestServerVolumeAttachmentScenario-1419127608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b" returned: 0 in 0.809s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [req-722bb1ef-87c5-4370-ab34-1c7ce8faf5d7 req-4d37e545-d6f6-4d05-8bc4-df1fbb8d424a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:00 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-722bb1ef-87c5-4370-ab34-1c7ce8faf5d7 req-4d37e545-d6f6-4d05-8bc4-df1fbb8d424a tempest-TestServerVolumeAttachmentScenario-1419127608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b', 'name': 'volume-248b3546-cccb-4db9-b558-fb82b6b99d7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11fd5a7a-36e0-4ed7-9c12-3a21947ad837', 'enforce_multipath': True} {{(pid=93300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:31:00 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-722bb1ef-87c5-4370-ab34-1c7ce8faf5d7 req-4d37e545-d6f6-4d05-8bc4-df1fbb8d424a tempest-TestServerVolumeAttachmentScenario-1419127608 None] attachment_update completed successfully. Jun 19 04:31:07 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-7d55ffbd-97c2-448b-ac46-574b85474a6a req-78e746cc-7ee1-4dee-9d0a-cd776b9a7bc9 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Terminate volume connection completed successfully. Jun 19 04:31:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-7d55ffbd-97c2-448b-ac46-574b85474a6a req-78e746cc-7ee1-4dee-9d0a-cd776b9a7bc9 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Deleting attachment 11fd5a7a-36e0-4ed7-9c12-3a21947ad837. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:31:10 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=31,cinder:SELECT=33,cinder:INSERT=6,cinder:DELETE=3 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:31:11 devstack cinder-volume[93300]: INFO cinder.volume.manager [req-d84c0598-4ae9-4e25-a3fd-a0e037af8f08 req-dc1d4f8a-d425-402b-b190-8e6779d9c718 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Terminate volume connection completed successfully. Jun 19 04:31:11 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [req-d84c0598-4ae9-4e25-a3fd-a0e037af8f08 req-dc1d4f8a-d425-402b-b190-8e6779d9c718 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Deleting attachment dfbe0074-4899-4d17-a041-56a246807777. {{(pid=93300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:31:17 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=39,cinder:UPDATE=32,cinder:INSERT=8,cinder:DELETE=2 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:31:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:31:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:19 devstack sudo[111062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:31:19 devstack sudo[111062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:19 devstack sudo[111062]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.622s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:19 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:31:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 29 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:31:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:31:21 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=2 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:31:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Acquiring lock "cinder-248b3546-cccb-4db9-b558-fb82b6b99d7b-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "cinder-248b3546-cccb-4db9-b558-fb82b6b99d7b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Acquiring lock "cinder-quobyte-248b3546-cccb-4db9-b558-fb82b6b99d7b" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "cinder-quobyte-248b3546-cccb-4db9-b558-fb82b6b99d7b" acquired by "delete_volume" :: waited 0.013s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:21 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f333aca-c4ef-4637-a4ec-d027163b8c01]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:21 devstack sudo[111067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b Jun 19 04:31:21 devstack sudo[111067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:22 devstack sudo[111067]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b" returned: 0 in 0.790s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:22 devstack sudo[111072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b Jun 19 04:31:22 devstack sudo[111072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:23 devstack sudo[111072]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-248b3546-cccb-4db9-b558-fb82b6b99d7b" returned: 0 in 0.626s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "cinder-quobyte-248b3546-cccb-4db9-b558-fb82b6b99d7b" released by "delete_volume" :: held 1.455s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Created reservations ['6816a3f9-c222-4040-9bdb-64f7c011a42c', 'b0fe3d00-6bf6-4a74-9c8e-824a3e68a61e', '9b03a81e-ca0a-4f3e-a3e1-6b120cae9a8b', '659c232f-f6bc-4af9-9800-adc644035b9d'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:23 devstack sudo[111075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:31:23 devstack sudo[111075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Acquiring lock "cinder-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "cinder-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Acquiring lock "cinder-quobyte-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "cinder-quobyte-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b" acquired by "delete_volume" :: waited 0.021s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:23 devstack sudo[111075]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d30dc98-12d2-43a4-9b76-92347b863e69]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.705s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:23 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Deleted volume successfully. Jun 19 04:31:23 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5bb39b7d-d2c5-4acd-ac11-a1e2801d7d5c tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "cinder-248b3546-cccb-4db9-b558-fb82b6b99d7b-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:23 devstack sudo[111084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b Jun 19 04:31:23 devstack sudo[111084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:24 devstack sudo[111084]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b" returned: 0 in 0.741s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:24 devstack sudo[111089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b Jun 19 04:31:24 devstack sudo[111089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:25 devstack sudo[111089]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b" returned: 0 in 0.660s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:25 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "cinder-quobyte-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b" released by "delete_volume" :: held 1.439s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:25 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Created reservations ['940821e9-a803-4e67-953b-17c0c5390033', '8e2d8d66-40c7-4db9-bd35-8d7569442926', 'f166d60f-e803-4c60-85da-3db7fe332a33', '9dc2c233-92ad-4390-9d8c-09c251e40f42'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:31:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:25 devstack sudo[111092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:31:25 devstack sudo[111092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:26 devstack sudo[111092]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.634s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:26 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:26 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Deleted volume successfully. Jun 19 04:31:26 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3fc9d053-18bc-4c1f-a87c-c4c88bc8d350 tempest-TestServerVolumeAttachmentScenario-1419127608 None] Lock "cinder-4ddcb9a5-f2e2-430a-88cd-fb7a4eabff0b-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=12 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Flow 'volume_create_manager' (ee7961ef-d1f9-4c6a-876c-f6bf49e949c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347fc968-d6be-4f9f-ae83-8becf62f6afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347fc968-d6be-4f9f-ae83-8becf62f6afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1169111307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6efad6-692d-404a-80c2-669a5b7f96be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449699535ae74eb8ba46698625428ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:35Z,use_quota=True,user_id='8f487d89a47e4f6d802dedd5234f7467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d8c7dc-1339-4dbc-bc3e-d3417fd3a0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d8c7dc-1339-4dbc-bc3e-d3417fd3a0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e602a370-91c8-46e6-b218-ec1953babe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e602a370-91c8-46e6-b218-ec1953babe0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e6efad6-692d-404a-80c2-669a5b7f96be', 'volume_name': 'volume-9e6efad6-692d-404a-80c2-669a5b7f96be', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ccd53a-80a6-4323-9f90-7036968ee28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ccd53a-80a6-4323-9f90-7036968ee28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c8b6d2-4f0a-4d3a-a042-a4c4fd2e53a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:35 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume 9e6efad6-692d-404a-80c2-669a5b7f96be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e6efad6-692d-404a-80c2-669a5b7f96be', 'volume_size': 1} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1169111307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6efad6-692d-404a-80c2-669a5b7f96be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449699535ae74eb8ba46698625428ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:35Z,use_quota=True,user_id='8f487d89a47e4f6d802dedd5234f7467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Creating volume 9e6efad6-692d-404a-80c2-669a5b7f96be {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:31:35 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:31:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:35 devstack sudo[111100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be 1073741824 Jun 19 04:31:35 devstack sudo[111100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:36 devstack sudo[111100]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be 1073741824" returned: 0 in 0.797s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:36 devstack sudo[111106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be Jun 19 04:31:36 devstack sudo[111106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:37 devstack sudo[111106]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be" returned: 0 in 0.625s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:31:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c8b6d2-4f0a-4d3a-a042-a4c4fd2e53a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e6efad6-692d-404a-80c2-669a5b7f96be', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db131b0-4e58-4962-862a-cdfb45749928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:37 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume volume-9e6efad6-692d-404a-80c2-669a5b7f96be (9e6efad6-692d-404a-80c2-669a5b7f96be): created successfully Jun 19 04:31:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db131b0-4e58-4962-862a-cdfb45749928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Flow 'volume_create_manager' (ee7961ef-d1f9-4c6a-876c-f6bf49e949c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:37 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-892811e5-1cc9-47b3-bf2f-610022c6d259 tempest-CreateVolumesFromSnapshotTest-439643936 None] Created volume successfully. Jun 19 04:31:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:37 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] Creating offline snapshot f9780042-18e2-4fc7-9b53-84fd246d4928 of volume 9e6efad6-692d-404a-80c2-669a5b7f96be {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:31:37 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dec2c1-5398-47ca-92ad-1a4e0e3aba54]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:37 devstack sudo[111109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be Jun 19 04:31:37 devstack sudo[111109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:38 devstack sudo[111109]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be" returned: 0 in 0.726s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:38 devstack sudo[111114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 1G Jun 19 04:31:38 devstack sudo[111114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:39 devstack sudo[111114]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 1G" returned: 0 in 0.751s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6efad6-692d-404a-80c2-669a5b7f96be -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:39 devstack sudo[111119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6efad6-692d-404a-80c2-669a5b7f96be -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 Jun 19 04:31:39 devstack sudo[111119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:39 devstack sudo[111119]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6efad6-692d-404a-80c2-669a5b7f96be -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928" returned: 0 in 0.661s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:39 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 is being set with open permissions: ugo+rw Jun 19 04:31:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:39 devstack sudo[111125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 Jun 19 04:31:39 devstack sudo[111125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:40 devstack sudo[111125]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928" returned: 0 in 0.612s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:40 devstack sudo[111128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.info Jun 19 04:31:40 devstack sudo[111128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:41 devstack sudo[111128]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.info" returned: 0 in 0.616s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:41 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.info is being set with open permissions: ugo+rw Jun 19 04:31:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:41 devstack sudo[111131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.info Jun 19 04:31:41 devstack sudo[111131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:41 devstack sudo[111131]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.info" returned: 0 in 0.603s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.056s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:41 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-5e098b3d-0890-4cf1-9a99-6d4bf50e0019 tempest-CreateVolumesFromSnapshotTest-439643936 None] Create snapshot completed successfully Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Flow 'volume_create_manager' (57b92a96-13f0-4446-b0bb-066423cbe63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b766daba-9288-466e-97fe-05713dbc4a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b766daba-9288-466e-97fe-05713dbc4a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-623613089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a45448-a9bb-47d6-97bf-c9d2e21dc8a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449699535ae74eb8ba46698625428ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:42Z,use_quota=True,user_id='8f487d89a47e4f6d802dedd5234f7467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e586a6-c6ee-481f-ab97-42228717a6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e586a6-c6ee-481f-ab97-42228717a6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3867222-5181-4444-b213-8ff63eef8fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3867222-5181-4444-b213-8ff63eef8fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a45448-a9bb-47d6-97bf-c9d2e21dc8a0', 'volume_name': 'volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c7555b-1a69-4145-b656-e33c72764a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c7555b-1a69-4145-b656-e33c72764a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb1f4cc-2135-4cbc-b143-f70d292a2fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:42 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume 51a45448-a9bb-47d6-97bf-c9d2e21dc8a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0', 'volume_size': 1} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-623613089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a45448-a9bb-47d6-97bf-c9d2e21dc8a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449699535ae74eb8ba46698625428ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:42Z,use_quota=True,user_id='8f487d89a47e4f6d802dedd5234f7467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Creating volume 51a45448-a9bb-47d6-97bf-c9d2e21dc8a0 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:31:42 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:42 devstack sudo[111170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0 1073741824 Jun 19 04:31:42 devstack sudo[111170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Flow 'volume_create_manager' (f7f8e6d9-c947-43e7-b935-8fb3c8aa182a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94de4e63-4360-44df-84be-d8e2778a5f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94de4e63-4360-44df-84be-d8e2778a5f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1185056686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3dd306-e070-48e9-8bfb-21dd54bb67e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449699535ae74eb8ba46698625428ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:43Z,use_quota=True,user_id='8f487d89a47e4f6d802dedd5234f7467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04c0812-b23a-4d03-905e-321d48699f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04c0812-b23a-4d03-905e-321d48699f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b46174-cac1-45d2-913d-3c5f97578395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b46174-cac1-45d2-913d-3c5f97578395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da3dd306-e070-48e9-8bfb-21dd54bb67e5', 'volume_name': 'volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b6aadd-a546-46df-a59f-01b77390dbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b6aadd-a546-46df-a59f-01b77390dbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188d0e5d-5121-40fb-8adc-ab42475cb684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:42 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume da3dd306-e070-48e9-8bfb-21dd54bb67e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5', 'volume_size': 1} Jun 19 04:31:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Flow 'volume_create_manager' (52f7c100-eee1-45f3-892a-aa7a139b0f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfb5825-017d-4cd4-b071-917980e2181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfb5825-017d-4cd4-b071-917980e2181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-856138687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f0bd35-c006-44fc-b75a-77ea609fec90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449699535ae74eb8ba46698625428ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:43Z,use_quota=True,user_id='8f487d89a47e4f6d802dedd5234f7467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e042cab2-8876-42d9-a595-69007a6302a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e042cab2-8876-42d9-a595-69007a6302a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722e8969-ffd6-477e-ad02-56fe93b9dfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722e8969-ffd6-477e-ad02-56fe93b9dfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1f0bd35-c006-44fc-b75a-77ea609fec90', 'volume_name': 'volume-d1f0bd35-c006-44fc-b75a-77ea609fec90', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47da6aed-b8e6-487f-84c9-ac6fec1701a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47da6aed-b8e6-487f-84c9-ac6fec1701a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44dea253-2e3d-476c-9043-5c529b3f4dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:43 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume d1f0bd35-c006-44fc-b75a-77ea609fec90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1f0bd35-c006-44fc-b75a-77ea609fec90', 'volume_size': 1} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:43 devstack sudo[111170]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0 1073741824" returned: 0 in 0.932s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:43 devstack sudo[111175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0 Jun 19 04:31:43 devstack sudo[111175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Flow 'volume_create_manager' (624afa41-ec15-40eb-9cd3-b997723cfae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6cd3a6-78f7-4924-8627-5cea6d188050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6cd3a6-78f7-4924-8627-5cea6d188050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-511944819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b580da47-7982-4028-b344-5e1072f1974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449699535ae74eb8ba46698625428ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:43Z,use_quota=True,user_id='8f487d89a47e4f6d802dedd5234f7467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4bc3ef-9171-4ffa-9dad-e3e35082b12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4bc3ef-9171-4ffa-9dad-e3e35082b12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53e3dd6-56f4-4ee8-9455-25d5b2bb1dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53e3dd6-56f4-4ee8-9455-25d5b2bb1dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b580da47-7982-4028-b344-5e1072f1974d', 'volume_name': 'volume-b580da47-7982-4028-b344-5e1072f1974d', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3370ec-c6b3-4b7b-afa4-76815fcb479e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3370ec-c6b3-4b7b-afa4-76815fcb479e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff429060-8a18-493d-81f5-504e23cd961e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:43 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume b580da47-7982-4028-b344-5e1072f1974d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b580da47-7982-4028-b344-5e1072f1974d', 'volume_size': 1} Jun 19 04:31:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Flow 'volume_create_manager' (9353e8d6-6bd5-454a-9faf-15b475678fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d10e226-0922-4465-8b19-f6d61096eafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d10e226-0922-4465-8b19-f6d61096eafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-312209883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45108ef2-38df-4e6c-bf5d-741ea72c0f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449699535ae74eb8ba46698625428ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:44Z,use_quota=True,user_id='8f487d89a47e4f6d802dedd5234f7467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404d6288-420b-4873-87ac-0e67957d0ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404d6288-420b-4873-87ac-0e67957d0ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e378fbf-7dc1-4435-a676-ce5c2c37b6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e378fbf-7dc1-4435-a676-ce5c2c37b6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45108ef2-38df-4e6c-bf5d-741ea72c0f5f', 'volume_name': 'volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:44 devstack sudo[111175]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f36a7d-5938-463e-819a-ee9a87ba3d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f36a7d-5938-463e-819a-ee9a87ba3d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527f6dbd-eef9-44d1-85b1-2b4685b0785b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:44 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume 45108ef2-38df-4e6c-bf5d-741ea72c0f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f', 'volume_size': 1} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0" returned: 0 in 0.720s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.315s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1185056686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3dd306-e070-48e9-8bfb-21dd54bb67e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449699535ae74eb8ba46698625428ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:43Z,use_quota=True,user_id='8f487d89a47e4f6d802dedd5234f7467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Creating volume da3dd306-e070-48e9-8bfb-21dd54bb67e5 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:31:44 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb1f4cc-2135-4cbc-b143-f70d292a2fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:44 devstack sudo[111178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5 1073741824 Jun 19 04:31:44 devstack sudo[111178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47337d1f-a022-45f6-a0e5-f5f7c808ea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:44 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0 (51a45448-a9bb-47d6-97bf-c9d2e21dc8a0): created successfully Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47337d1f-a022-45f6-a0e5-f5f7c808ea8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Flow 'volume_create_manager' (57b92a96-13f0-4446-b0bb-066423cbe63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:44 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-770e7591-28f3-4999-a92f-3422946cb8b6 tempest-CreateVolumesFromSnapshotTest-439643936 None] Created volume successfully. Jun 19 04:31:44 devstack sudo[111178]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5 1073741824" returned: 0 in 0.807s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:45 devstack sudo[111183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5 Jun 19 04:31:45 devstack sudo[111183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:45 devstack sudo[111183]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5" returned: 0 in 0.621s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.433s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-856138687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f0bd35-c006-44fc-b75a-77ea609fec90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449699535ae74eb8ba46698625428ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:43Z,use_quota=True,user_id='8f487d89a47e4f6d802dedd5234f7467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Creating volume d1f0bd35-c006-44fc-b75a-77ea609fec90 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:31:45 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d1f0bd35-c006-44fc-b75a-77ea609fec90 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:45 devstack sudo[111186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d1f0bd35-c006-44fc-b75a-77ea609fec90 1073741824 Jun 19 04:31:45 devstack sudo[111186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188d0e5d-5121-40fb-8adc-ab42475cb684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1540c0-6e45-439d-aad3-280f8951fb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:45 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5 (da3dd306-e070-48e9-8bfb-21dd54bb67e5): created successfully Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1540c0-6e45-439d-aad3-280f8951fb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Flow 'volume_create_manager' (f7f8e6d9-c947-43e7-b935-8fb3c8aa182a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:45 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-bbaffec3-c924-44e5-951d-05ed62655124 tempest-CreateVolumesFromSnapshotTest-439643936 None] Created volume successfully. Jun 19 04:31:46 devstack sudo[111186]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d1f0bd35-c006-44fc-b75a-77ea609fec90 1073741824" returned: 0 in 0.858s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d1f0bd35-c006-44fc-b75a-77ea609fec90 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:46 devstack sudo[111191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d1f0bd35-c006-44fc-b75a-77ea609fec90 Jun 19 04:31:46 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:47 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d1f0bd35-c006-44fc-b75a-77ea609fec90" returned: 0 in 0.636s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.568s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-511944819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b580da47-7982-4028-b344-5e1072f1974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449699535ae74eb8ba46698625428ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:43Z,use_quota=True,user_id='8f487d89a47e4f6d802dedd5234f7467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Creating volume b580da47-7982-4028-b344-5e1072f1974d {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:31:47 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b580da47-7982-4028-b344-5e1072f1974d 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44dea253-2e3d-476c-9043-5c529b3f4dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1f0bd35-c006-44fc-b75a-77ea609fec90', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4445b4ab-5a87-470c-90c9-fcbb8859879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:47 devstack sudo[111194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b580da47-7982-4028-b344-5e1072f1974d 1073741824 Jun 19 04:31:47 devstack sudo[111194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:47 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume volume-d1f0bd35-c006-44fc-b75a-77ea609fec90 (d1f0bd35-c006-44fc-b75a-77ea609fec90): created successfully Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4445b4ab-5a87-470c-90c9-fcbb8859879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Flow 'volume_create_manager' (52f7c100-eee1-45f3-892a-aa7a139b0f81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:47 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c99c282d-8186-4487-8a98-bd1d398296b0 tempest-CreateVolumesFromSnapshotTest-439643936 None] Created volume successfully. Jun 19 04:31:48 devstack sudo[111194]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b580da47-7982-4028-b344-5e1072f1974d 1073741824" returned: 0 in 0.837s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b580da47-7982-4028-b344-5e1072f1974d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:48 devstack sudo[111200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b580da47-7982-4028-b344-5e1072f1974d Jun 19 04:31:48 devstack sudo[111200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:48 devstack sudo[111200]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b580da47-7982-4028-b344-5e1072f1974d" returned: 0 in 0.631s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.543s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-312209883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45108ef2-38df-4e6c-bf5d-741ea72c0f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449699535ae74eb8ba46698625428ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:44Z,use_quota=True,user_id='8f487d89a47e4f6d802dedd5234f7467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Creating volume 45108ef2-38df-4e6c-bf5d-741ea72c0f5f {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:31:48 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:48 devstack sudo[111203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f 1073741824 Jun 19 04:31:48 devstack sudo[111203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff429060-8a18-493d-81f5-504e23cd961e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b580da47-7982-4028-b344-5e1072f1974d', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b70484-7845-4ea2-b601-c992e77b9f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:48 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume volume-b580da47-7982-4028-b344-5e1072f1974d (b580da47-7982-4028-b344-5e1072f1974d): created successfully Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b70484-7845-4ea2-b601-c992e77b9f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Flow 'volume_create_manager' (624afa41-ec15-40eb-9cd3-b997723cfae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:48 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d1c14b10-4b3b-4c99-a221-bcc72e1cd6ee tempest-CreateVolumesFromSnapshotTest-439643936 None] Created volume successfully. Jun 19 04:31:49 devstack sudo[111203]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f 1073741824" returned: 0 in 0.810s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:49 devstack sudo[111208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f Jun 19 04:31:49 devstack sudo[111208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:50 devstack sudo[111208]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f" returned: 0 in 0.628s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:31:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527f6dbd-eef9-44d1-85b1-2b4685b0785b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806966f0-794f-4f4b-b0a6-0705b543e85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:50 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Volume volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f (45108ef2-38df-4e6c-bf5d-741ea72c0f5f): created successfully Jun 19 04:31:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806966f0-794f-4f4b-b0a6-0705b543e85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Flow 'volume_create_manager' (9353e8d6-6bd5-454a-9faf-15b475678fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:50 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-410a303b-58c8-4d0a-8094-ebaa3f616a6a tempest-CreateVolumesFromSnapshotTest-439643936 None] Created volume successfully. Jun 19 04:31:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-45108ef2-38df-4e6c-bf5d-741ea72c0f5f-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-45108ef2-38df-4e6c-bf5d-741ea72c0f5f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-quobyte-45108ef2-38df-4e6c-bf5d-741ea72c0f5f" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-45108ef2-38df-4e6c-bf5d-741ea72c0f5f" acquired by "delete_volume" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:50 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5879a971-17e5-4149-8336-3d0ffebb7559]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:50 devstack sudo[111212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f Jun 19 04:31:50 devstack sudo[111212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:51 devstack sudo[111212]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f" returned: 0 in 0.715s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:51 devstack sudo[111217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f Jun 19 04:31:51 devstack sudo[111217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:52 devstack sudo[111217]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-45108ef2-38df-4e6c-bf5d-741ea72c0f5f" returned: 0 in 0.653s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-45108ef2-38df-4e6c-bf5d-741ea72c0f5f" released by "delete_volume" :: held 1.412s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Created reservations ['cb88dd13-852a-4554-9ce3-3a5256c492bd', '2d869a65-95d7-4619-8f2b-4451c39610e8', 'e2eac2da-01ae-4ed0-aafa-d7183639050e', '6123f5d5-82b5-43bb-8e10-53f4e413a029'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:52 devstack sudo[111220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:31:52 devstack sudo[111220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:52 devstack sudo[111220]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.630s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:52 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Deleted volume successfully. Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-b580da47-7982-4028-b344-5e1072f1974d-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-b580da47-7982-4028-b344-5e1072f1974d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-3601d290-89dc-4add-81b6-b8a1ad592219 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-45108ef2-38df-4e6c-bf5d-741ea72c0f5f-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-quobyte-b580da47-7982-4028-b344-5e1072f1974d" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-b580da47-7982-4028-b344-5e1072f1974d" acquired by "delete_volume" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4388b90-10f0-4ce3-984d-0cdfc21505d3]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b580da47-7982-4028-b344-5e1072f1974d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:53 devstack sudo[111223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b580da47-7982-4028-b344-5e1072f1974d Jun 19 04:31:53 devstack sudo[111223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:53 devstack sudo[111223]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b580da47-7982-4028-b344-5e1072f1974d" returned: 0 in 0.735s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b580da47-7982-4028-b344-5e1072f1974d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:53 devstack sudo[111228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b580da47-7982-4028-b344-5e1072f1974d Jun 19 04:31:53 devstack sudo[111228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:54 devstack sudo[111228]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-b580da47-7982-4028-b344-5e1072f1974d" returned: 0 in 0.637s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-b580da47-7982-4028-b344-5e1072f1974d" released by "delete_volume" :: held 1.411s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:54 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Created reservations ['32960f64-9627-4e9f-b020-7b33f4dc1b47', '500d7c80-94c6-4369-af4a-ab7cec6c0b8d', '576981e7-63e9-45c8-853e-44d3fc23d8e4', '0955e0ce-c997-4652-a78b-3868b9739171'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:31:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:54 devstack sudo[111231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:31:54 devstack sudo[111231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:55 devstack sudo[111231]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.622s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:55 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-d1f0bd35-c006-44fc-b75a-77ea609fec90-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:55 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Deleted volume successfully. Jun 19 04:31:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-d1f0bd35-c006-44fc-b75a-77ea609fec90-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-4a5d7893-8f58-4dbb-a440-0bf9094c2c74 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-b580da47-7982-4028-b344-5e1072f1974d-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-quobyte-d1f0bd35-c006-44fc-b75a-77ea609fec90" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-d1f0bd35-c006-44fc-b75a-77ea609fec90" acquired by "delete_volume" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:55 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[57eda079-2683-4f26-b4c5-422b6b68f866]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d1f0bd35-c006-44fc-b75a-77ea609fec90 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:55 devstack sudo[111234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d1f0bd35-c006-44fc-b75a-77ea609fec90 Jun 19 04:31:55 devstack sudo[111234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:55 devstack sudo[111234]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d1f0bd35-c006-44fc-b75a-77ea609fec90" returned: 0 in 0.714s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d1f0bd35-c006-44fc-b75a-77ea609fec90 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:55 devstack sudo[111239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d1f0bd35-c006-44fc-b75a-77ea609fec90 Jun 19 04:31:55 devstack sudo[111239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:56 devstack sudo[111239]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d1f0bd35-c006-44fc-b75a-77ea609fec90" returned: 0 in 0.647s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-d1f0bd35-c006-44fc-b75a-77ea609fec90" released by "delete_volume" :: held 1.398s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:56 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Created reservations ['47d68002-1fad-4e49-a738-6f5fda9e69b2', 'e6f6d7a5-c140-4db4-a1e8-3ebb01861a9d', 'c32d7c81-c2b2-40fd-8488-b330536c85ba', '99064e25-9112-457e-ba06-c89fc0021bee'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:31:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:56 devstack sudo[111242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:31:56 devstack sudo[111242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-da3dd306-e070-48e9-8bfb-21dd54bb67e5-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:57 devstack sudo[111242]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.633s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:57 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:57 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Deleted volume successfully. Jun 19 04:31:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-da3dd306-e070-48e9-8bfb-21dd54bb67e5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8728583b-27d8-4e03-8800-578e504210ab tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-d1f0bd35-c006-44fc-b75a-77ea609fec90-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-quobyte-da3dd306-e070-48e9-8bfb-21dd54bb67e5" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-da3dd306-e070-48e9-8bfb-21dd54bb67e5" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:57 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52ac3a3-f938-4503-82f1-fb1c19b459ef]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:57 devstack sudo[111245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5 Jun 19 04:31:57 devstack sudo[111245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:58 devstack sudo[111245]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5" returned: 0 in 0.742s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:58 devstack sudo[111250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5 Jun 19 04:31:58 devstack sudo[111250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:58 devstack sudo[111250]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-da3dd306-e070-48e9-8bfb-21dd54bb67e5" returned: 0 in 0.620s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-da3dd306-e070-48e9-8bfb-21dd54bb67e5" released by "delete_volume" :: held 1.409s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:58 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Created reservations ['44ae094d-38cf-4e20-947c-b2a0974c6bee', 'd4de013a-53df-4758-a19c-3eaf2848cd7e', 'f9b6619f-2383-4293-8664-b8dd3604a62b', '0a6b879f-afc8-473c-b32b-2c86cf676687'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:31:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:58 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:58 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:58 devstack sudo[111254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:31:58 devstack sudo[111254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:59 devstack sudo[111254]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.616s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:59 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:59 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Deleted volume successfully. Jun 19 04:31:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0d598d0a-bf21-4dd1-9222-5865175b0f02 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-da3dd306-e070-48e9-8bfb-21dd54bb67e5-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-quobyte-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0" acquired by "delete_volume" :: waited 0.013s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:59 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[342f83df-7494-45f4-91b6-de6aa4d529ff]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:59 devstack sudo[111257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0 Jun 19 04:31:59 devstack sudo[111257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:00 devstack sudo[111257]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0" returned: 0 in 0.752s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:00 devstack sudo[111263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0 Jun 19 04:32:00 devstack sudo[111263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:01 devstack sudo[111263]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0" returned: 0 in 0.633s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0" released by "delete_volume" :: held 1.429s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Created reservations ['b70cdccb-6980-4825-9b32-f2f8b52d2468', '4747b750-bf2a-433d-9fd3-ddac0106b234', '29f40b94-1b56-40e1-85d2-a0bfde8b9f6c', 'b2cc3237-c477-4f56-8fd5-e0d2c625e22b'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:01 devstack sudo[111267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:32:01 devstack sudo[111267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-f9780042-18e2-4fc7-9b53-84fd246d4928-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-f9780042-18e2-4fc7-9b53-84fd246d4928-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-quobyte-9e6efad6-692d-404a-80c2-669a5b7f96be" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-9e6efad6-692d-404a-80c2-669a5b7f96be" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:01 devstack sudo[111267]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-quobyte-f9780042-18e2-4fc7-9b53-84fd246d4928" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.658s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-f9780042-18e2-4fc7-9b53-84fd246d4928" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Deleting offline snapshot f9780042-18e2-4fc7-9b53-84fd246d4928 of volume 9e6efad6-692d-404a-80c2-669a5b7f96be {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] snapshot_file for this snap is: volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:32:01 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Deleted volume successfully. Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a04a83-bc2b-4918-9150-631d4c9c03e6]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-62eaf202-cb7c-48f3-9e14-1e4479cc54b2 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-51a45448-a9bb-47d6-97bf-c9d2e21dc8a0-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:01 devstack sudo[111270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 Jun 19 04:32:01 devstack sudo[111270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:02 devstack sudo[111270]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928" returned: 0 in 0.749s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6efad6-692d-404a-80c2-669a5b7f96be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:32:02 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ae7218-6454-4d27-b2b6-7a1dd42578f2]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:02 devstack sudo[111275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be Jun 19 04:32:02 devstack sudo[111275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:03 devstack sudo[111275]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be" returned: 0 in 0.745s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:03 devstack sudo[111280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 Jun 19 04:32:03 devstack sudo[111280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:04 devstack sudo[111280]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928" returned: 0 in 0.721s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:04 devstack sudo[111286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928 Jun 19 04:32:04 devstack sudo[111286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:04 devstack sudo[111286]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be.f9780042-18e2-4fc7-9b53-84fd246d4928" returned: 0 in 0.617s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-f9780042-18e2-4fc7-9b53-84fd246d4928" released by "_delete_snapshot" :: held 2.939s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-9e6efad6-692d-404a-80c2-669a5b7f96be" released by "delete_snapshot" :: held 2.964s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:04 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Created reservations ['70eba37d-65a5-4694-ba94-01bd70f2666e', '12f0ce27-637a-4b80-9473-5613e6e2bd2f', 'e5abd957-3c54-4441-a455-3db229625e52', '58bbf386-1718-4699-8980-0e810a01a1ab'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:04 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Delete snapshot completed successfully. Jun 19 04:32:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-41ee334f-8a1e-4d74-b514-c865081949dd tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-f9780042-18e2-4fc7-9b53-84fd246d4928-delete_snapshot" released by "delete_snapshot" :: held 3.103s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-9e6efad6-692d-404a-80c2-669a5b7f96be-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-9e6efad6-692d-404a-80c2-669a5b7f96be-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "cinder-quobyte-9e6efad6-692d-404a-80c2-669a5b7f96be" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-9e6efad6-692d-404a-80c2-669a5b7f96be" acquired by "delete_volume" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:05 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[48083de7-dc23-4fa7-bae1-88a919cf9a38]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:05 devstack sudo[111289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be Jun 19 04:32:05 devstack sudo[111289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:05 devstack sudo[111289]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be" returned: 0 in 0.736s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:05 devstack sudo[111294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be Jun 19 04:32:05 devstack sudo[111294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:06 devstack sudo[111294]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9e6efad6-692d-404a-80c2-669a5b7f96be" returned: 0 in 0.620s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-quobyte-9e6efad6-692d-404a-80c2-669a5b7f96be" released by "delete_volume" :: held 1.410s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:06 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Created reservations ['ba0b5024-d1d9-4e30-b113-8ced9a883e88', '118f6edf-0385-45f2-98b0-f9112d8ea8e4', 'ddc0714b-8f85-4b24-890d-73f26383d997', '227b432c-0776-4e0c-8b0c-32c04eefd5e2'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:06 devstack sudo[111297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:32:06 devstack sudo[111297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:07 devstack sudo[111297]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.644s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:07 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:07 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Deleted volume successfully. Jun 19 04:32:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-934e1d9c-3fbd-4b13-b55c-a998bec7c021 tempest-CreateVolumesFromSnapshotTest-439643936 None] Lock "cinder-9e6efad6-692d-404a-80c2-669a5b7f96be-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Flow 'volume_create_manager' (b87b570b-7160-4407-b6f1-e7bf57d1f87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c6e75e-e0f3-40ea-a945-dc7aab841e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c6e75e-e0f3-40ea-a945-dc7aab841e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1963681244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e13a3a-ecf7-495e-8feb-3c31ec52aa9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c28485374c4b9a9a0895c03f0dc95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:10Z,use_quota=True,user_id='ae996acad414419a87cecf59cae8d13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f514917d-242a-4e01-a8ab-6ca98c213b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f514917d-242a-4e01-a8ab-6ca98c213b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367ba615-eb25-4888-8460-89cff9e5f0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367ba615-eb25-4888-8460-89cff9e5f0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e13a3a-ecf7-495e-8feb-3c31ec52aa9e', 'volume_name': 'volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbee6491-a535-49aa-8dc1-514c57ff34de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbee6491-a535-49aa-8dc1-514c57ff34de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4646e052-4c92-46ea-ba41-f07ae570a17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:09 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume 90e13a3a-ecf7-495e-8feb-3c31ec52aa9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e', 'volume_size': 1} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1963681244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e13a3a-ecf7-495e-8feb-3c31ec52aa9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c28485374c4b9a9a0895c03f0dc95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:10Z,use_quota=True,user_id='ae996acad414419a87cecf59cae8d13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Creating volume 90e13a3a-ecf7-495e-8feb-3c31ec52aa9e {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:09 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:32:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:09 devstack sudo[111309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e 1073741824 Jun 19 04:32:09 devstack sudo[111309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:10 devstack sudo[111309]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e 1073741824" returned: 0 in 0.826s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:10 devstack sudo[111314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e Jun 19 04:32:10 devstack sudo[111314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:11 devstack sudo[111314]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e" returned: 0 in 0.641s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:11 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4646e052-4c92-46ea-ba41-f07ae570a17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:11 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52dde4a-6eb5-4ba5-99f8-d4aa6ec23adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:11 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e (90e13a3a-ecf7-495e-8feb-3c31ec52aa9e): created successfully Jun 19 04:32:11 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52dde4a-6eb5-4ba5-99f8-d4aa6ec23adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:11 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Flow 'volume_create_manager' (b87b570b-7160-4407-b6f1-e7bf57d1f87e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:11 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b14ceb63-483a-4207-bb51-8fdef846da8c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Created volume successfully. Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Flow 'volume_create_manager' (f2c233fd-4214-4e64-9c30-bd70cab445f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c1483b-9d5a-48b3-a58d-8a710e655e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c1483b-9d5a-48b3-a58d-8a710e655e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1533491310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7fe96f-abc9-4df8-be7e-92b0b44de929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c28485374c4b9a9a0895c03f0dc95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:12Z,use_quota=True,user_id='ae996acad414419a87cecf59cae8d13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685cc064-16ae-488e-80f0-a27b6b8f0f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685cc064-16ae-488e-80f0-a27b6b8f0f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b02bafa-cf20-484d-969c-082d264262ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b02bafa-cf20-484d-969c-082d264262ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a7fe96f-abc9-4df8-be7e-92b0b44de929', 'volume_name': 'volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03048981-5cab-441d-a80f-113a70327c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03048981-5cab-441d-a80f-113a70327c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3268004-0ba3-4d99-8b35-948538fd1678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:12 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume 5a7fe96f-abc9-4df8-be7e-92b0b44de929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929', 'volume_size': 1} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1533491310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7fe96f-abc9-4df8-be7e-92b0b44de929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c28485374c4b9a9a0895c03f0dc95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:12Z,use_quota=True,user_id='ae996acad414419a87cecf59cae8d13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Creating volume 5a7fe96f-abc9-4df8-be7e-92b0b44de929 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:12 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:12 devstack sudo[111317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929 1073741824 Jun 19 04:32:12 devstack sudo[111317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Flow 'volume_create_manager' (6c9c009a-1d14-4d1d-a3cb-6c764b06445d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac21b51-5cee-48ec-921a-0e163c270261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac21b51-5cee-48ec-921a-0e163c270261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1773903369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5f2ea1-a565-491c-a0d3-a54405a3e0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c28485374c4b9a9a0895c03f0dc95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:13Z,use_quota=True,user_id='ae996acad414419a87cecf59cae8d13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a84341-6482-4952-b7ca-90e79d305e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a84341-6482-4952-b7ca-90e79d305e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2f230b-067c-4ede-a804-d699e281e6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2f230b-067c-4ede-a804-d699e281e6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b5f2ea1-a565-491c-a0d3-a54405a3e0f2', 'volume_name': 'volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee96c6d-334e-4ab6-8c2e-4985992bfe2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee96c6d-334e-4ab6-8c2e-4985992bfe2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72f317b-9cab-470f-81f2-d2a37b8b4cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:12 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume 7b5f2ea1-a565-491c-a0d3-a54405a3e0f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2', 'volume_size': 1} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:12 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Flow 'volume_create_manager' (9caa2258-04c4-49ca-a5f3-add3ecfd2a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7628c7-839a-41a1-a2be-80ee651b11d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7628c7-839a-41a1-a2be-80ee651b11d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-856670786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c59a04-bb55-4170-8e60-8dbdb012bb73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c28485374c4b9a9a0895c03f0dc95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:13Z,use_quota=True,user_id='ae996acad414419a87cecf59cae8d13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78861e38-c152-4bd8-9b01-2501c495f8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78861e38-c152-4bd8-9b01-2501c495f8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e3824b-6d7e-469b-8187-685775d55847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e3824b-6d7e-469b-8187-685775d55847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c59a04-bb55-4170-8e60-8dbdb012bb73', 'volume_name': 'volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5d3759-a8d1-4e40-93cb-319cbc4ec66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5d3759-a8d1-4e40-93cb-319cbc4ec66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b463289-71e4-4a76-9354-dbe8a267d3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume c6c59a04-bb55-4170-8e60-8dbdb012bb73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73', 'volume_size': 1} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:13 devstack sudo[111317]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929 1073741824" returned: 0 in 1.001s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Flow 'volume_create_manager' (675f0430-17cb-4dc9-a6d9-58515a81f825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b73484-ad74-4d08-a443-30d40fc17184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b73484-ad74-4d08-a443-30d40fc17184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1111883327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36810b02-88da-4674-a23a-95b0b1da1a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c28485374c4b9a9a0895c03f0dc95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:13Z,use_quota=True,user_id='ae996acad414419a87cecf59cae8d13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f9e17c-72da-4071-9f42-265b0871dc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f9e17c-72da-4071-9f42-265b0871dc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3cc9b1-0d81-4b55-9ee4-1acab2e5a441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3cc9b1-0d81-4b55-9ee4-1acab2e5a441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36810b02-88da-4674-a23a-95b0b1da1a39', 'volume_name': 'volume-36810b02-88da-4674-a23a-95b0b1da1a39', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ec3eb0-f10c-4cbb-9bc5-eaf2accdbd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ec3eb0-f10c-4cbb-9bc5-eaf2accdbd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04553de-717e-46ab-97b6-367f02dced1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume 36810b02-88da-4674-a23a-95b0b1da1a39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36810b02-88da-4674-a23a-95b0b1da1a39', 'volume_size': 1} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:13 devstack sudo[111324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929 Jun 19 04:32:13 devstack sudo[111324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Flow 'volume_create_manager' (bc9f369c-d9bb-4e05-9f76-ba4d30204f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faee53b1-a092-4718-87ac-edd59ceeef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faee53b1-a092-4718-87ac-edd59ceeef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-140353209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c2836f-0773-464f-9424-1258845eae90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c28485374c4b9a9a0895c03f0dc95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:14Z,use_quota=True,user_id='ae996acad414419a87cecf59cae8d13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c807937-4092-42d0-a986-3d5f5ed90e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c807937-4092-42d0-a986-3d5f5ed90e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c720084c-3f25-4901-95a0-46f6384271d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c720084c-3f25-4901-95a0-46f6384271d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84c2836f-0773-464f-9424-1258845eae90', 'volume_name': 'volume-84c2836f-0773-464f-9424-1258845eae90', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe40dca-b4c8-48d8-baad-89982e2bd35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe40dca-b4c8-48d8-baad-89982e2bd35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ef27cd-88c6-486b-b6d1-60b31fbbd33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:13 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume 84c2836f-0773-464f-9424-1258845eae90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84c2836f-0773-464f-9424-1258845eae90', 'volume_size': 1} Jun 19 04:32:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:14 devstack sudo[111324]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929" returned: 0 in 0.654s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.402s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1773903369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5f2ea1-a565-491c-a0d3-a54405a3e0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c28485374c4b9a9a0895c03f0dc95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:13Z,use_quota=True,user_id='ae996acad414419a87cecf59cae8d13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Creating volume 7b5f2ea1-a565-491c-a0d3-a54405a3e0f2 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:14 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:14 devstack sudo[111328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2 1073741824 Jun 19 04:32:14 devstack sudo[111328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3268004-0ba3-4d99-8b35-948538fd1678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76a1512-4a5e-49c0-b3f1-b05331f7b91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:14 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929 (5a7fe96f-abc9-4df8-be7e-92b0b44de929): created successfully Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76a1512-4a5e-49c0-b3f1-b05331f7b91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Flow 'volume_create_manager' (f2c233fd-4214-4e64-9c30-bd70cab445f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:14 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-cab5a5bd-7683-4e95-b93f-ca4506efa9a0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Created volume successfully. Jun 19 04:32:14 devstack sudo[111328]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2 1073741824" returned: 0 in 0.813s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:14 devstack sudo[111334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2 Jun 19 04:32:15 devstack sudo[111334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:15 devstack sudo[111334]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2" returned: 0 in 0.629s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.496s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-856670786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c59a04-bb55-4170-8e60-8dbdb012bb73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c28485374c4b9a9a0895c03f0dc95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:13Z,use_quota=True,user_id='ae996acad414419a87cecf59cae8d13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Creating volume c6c59a04-bb55-4170-8e60-8dbdb012bb73 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:15 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72f317b-9cab-470f-81f2-d2a37b8b4cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:15 devstack sudo[111337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73 1073741824 Jun 19 04:32:15 devstack sudo[111337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29e4c33-f21b-46a2-a31d-093c817e9b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:15 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2 (7b5f2ea1-a565-491c-a0d3-a54405a3e0f2): created successfully Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29e4c33-f21b-46a2-a31d-093c817e9b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:15 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Flow 'volume_create_manager' (6c9c009a-1d14-4d1d-a3cb-6c764b06445d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:15 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-20608e97-becd-429c-bd3d-921a37419cd8 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Created volume successfully. Jun 19 04:32:16 devstack sudo[111337]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73 1073741824" returned: 0 in 0.779s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:16 devstack sudo[111342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73 Jun 19 04:32:16 devstack sudo[111342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:17 devstack sudo[111342]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73" returned: 0 in 0.641s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.611s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1111883327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36810b02-88da-4674-a23a-95b0b1da1a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c28485374c4b9a9a0895c03f0dc95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:13Z,use_quota=True,user_id='ae996acad414419a87cecf59cae8d13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Creating volume 36810b02-88da-4674-a23a-95b0b1da1a39 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:17 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-36810b02-88da-4674-a23a-95b0b1da1a39 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:17 devstack sudo[111347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-36810b02-88da-4674-a23a-95b0b1da1a39 1073741824 Jun 19 04:32:17 devstack sudo[111347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b463289-71e4-4a76-9354-dbe8a267d3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87eb66af-7ac6-41a6-9b43-030ac645a75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:17 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73 (c6c59a04-bb55-4170-8e60-8dbdb012bb73): created successfully Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87eb66af-7ac6-41a6-9b43-030ac645a75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Flow 'volume_create_manager' (9caa2258-04c4-49ca-a5f3-add3ecfd2a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:17 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-09816fa2-5744-4855-86af-5e1cf9cbeddd tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Created volume successfully. Jun 19 04:32:17 devstack sudo[111347]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-36810b02-88da-4674-a23a-95b0b1da1a39 1073741824" returned: 0 in 0.775s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=109,cinder:SELECT=71,cinder:INSERT=18,cinder:DELETE=12 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:32:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-36810b02-88da-4674-a23a-95b0b1da1a39 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:17 devstack sudo[111352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-36810b02-88da-4674-a23a-95b0b1da1a39 Jun 19 04:32:17 devstack sudo[111352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:18 devstack sudo[111352]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-36810b02-88da-4674-a23a-95b0b1da1a39" returned: 0 in 0.642s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.732s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-140353209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c2836f-0773-464f-9424-1258845eae90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c28485374c4b9a9a0895c03f0dc95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:14Z,use_quota=True,user_id='ae996acad414419a87cecf59cae8d13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Creating volume 84c2836f-0773-464f-9424-1258845eae90 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:18 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84c2836f-0773-464f-9424-1258845eae90 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04553de-717e-46ab-97b6-367f02dced1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36810b02-88da-4674-a23a-95b0b1da1a39', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:18 devstack sudo[111355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84c2836f-0773-464f-9424-1258845eae90 1073741824 Jun 19 04:32:18 devstack sudo[111355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145d5e9b-37d2-4638-9973-98ae988fd8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:18 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume volume-36810b02-88da-4674-a23a-95b0b1da1a39 (36810b02-88da-4674-a23a-95b0b1da1a39): created successfully Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145d5e9b-37d2-4638-9973-98ae988fd8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:18 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Flow 'volume_create_manager' (675f0430-17cb-4dc9-a6d9-58515a81f825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:18 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f2ebb13d-12e5-4068-86b6-d6eaa89c9a22 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Created volume successfully. Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:19 devstack sudo[111360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:32:19 devstack sudo[111360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:19 devstack sudo[111355]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84c2836f-0773-464f-9424-1258845eae90 1073741824" returned: 0 in 0.851s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84c2836f-0773-464f-9424-1258845eae90 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:19 devstack sudo[111362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84c2836f-0773-464f-9424-1258845eae90 Jun 19 04:32:19 devstack sudo[111362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:19 devstack sudo[111360]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.636s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 29 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:32:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:32:20 devstack sudo[111362]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84c2836f-0773-464f-9424-1258845eae90" returned: 0 in 0.616s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:20 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ef27cd-88c6-486b-b6d1-60b31fbbd33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84c2836f-0773-464f-9424-1258845eae90', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba184f5-48c1-4f21-9bf7-2dfa2aab8251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:20 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Volume volume-84c2836f-0773-464f-9424-1258845eae90 (84c2836f-0773-464f-9424-1258845eae90): created successfully Jun 19 04:32:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba184f5-48c1-4f21-9bf7-2dfa2aab8251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Flow 'volume_create_manager' (bc9f369c-d9bb-4e05-9f76-ba4d30204f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:20 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-a04fadf0-3fb7-490a-a25e-27b00d0cdd35 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Created volume successfully. Jun 19 04:32:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "cinder-84c2836f-0773-464f-9424-1258845eae90-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-84c2836f-0773-464f-9424-1258845eae90-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "cinder-quobyte-84c2836f-0773-464f-9424-1258845eae90" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-quobyte-84c2836f-0773-464f-9424-1258845eae90" acquired by "delete_volume" :: waited 0.012s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:20 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c503cbab-d17f-4a18-a7b9-dea4897126c8]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84c2836f-0773-464f-9424-1258845eae90 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:20 devstack sudo[111367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84c2836f-0773-464f-9424-1258845eae90 Jun 19 04:32:20 devstack sudo[111367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:21 devstack sudo[111367]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84c2836f-0773-464f-9424-1258845eae90" returned: 0 in 0.707s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84c2836f-0773-464f-9424-1258845eae90 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:21 devstack sudo[111373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84c2836f-0773-464f-9424-1258845eae90 Jun 19 04:32:21 devstack sudo[111373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:21 devstack sudo[111373]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-84c2836f-0773-464f-9424-1258845eae90" returned: 0 in 0.608s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:21 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-quobyte-84c2836f-0773-464f-9424-1258845eae90" released by "delete_volume" :: held 1.349s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:21 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Created reservations ['9432ff24-dacf-4aae-922c-7245ef11673b', '10332aac-ff08-4515-b365-05065178902a', 'f050d0e1-9870-4012-b241-7275f66fb879', 'aecd974a-156d-4a98-b894-6250b93f7d04'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:21 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:21 devstack sudo[111376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:32:21 devstack sudo[111376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "cinder-36810b02-88da-4674-a23a-95b0b1da1a39-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:22 devstack sudo[111376]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-36810b02-88da-4674-a23a-95b0b1da1a39-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.701s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:22 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:22 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Deleted volume successfully. Jun 19 04:32:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-08760ab5-82b9-48a4-a0f6-59e0dee4d826 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-84c2836f-0773-464f-9424-1258845eae90-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "cinder-quobyte-36810b02-88da-4674-a23a-95b0b1da1a39" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-quobyte-36810b02-88da-4674-a23a-95b0b1da1a39" acquired by "delete_volume" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:22 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d3e6e3-845a-4d06-b5a0-db9a08dd4f14]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-36810b02-88da-4674-a23a-95b0b1da1a39 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:22 devstack sudo[111379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-36810b02-88da-4674-a23a-95b0b1da1a39 Jun 19 04:32:22 devstack sudo[111379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:23 devstack sudo[111379]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-36810b02-88da-4674-a23a-95b0b1da1a39" returned: 0 in 0.721s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-36810b02-88da-4674-a23a-95b0b1da1a39 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:23 devstack sudo[111384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-36810b02-88da-4674-a23a-95b0b1da1a39 Jun 19 04:32:23 devstack sudo[111384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:23 devstack sudo[111384]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-36810b02-88da-4674-a23a-95b0b1da1a39" returned: 0 in 0.626s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:23 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-quobyte-36810b02-88da-4674-a23a-95b0b1da1a39" released by "delete_volume" :: held 1.382s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:23 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Created reservations ['4f1e552f-f024-4f0d-a048-4cacd7a7db2d', '227f0b24-a149-4de7-bc68-b6a376ff0bef', 'c508ed83-7d79-499f-8867-033cb708de80', '5b7ea55b-bbd5-4917-8de7-e8fb43d9d369'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:24 devstack sudo[111393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:32:24 devstack sudo[111393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:24 devstack sudo[111393]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.594s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:24 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Deleted volume successfully. Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a6c01be-d228-446a-ad00-57c1d7d5c964 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-36810b02-88da-4674-a23a-95b0b1da1a39-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "cinder-c6c59a04-bb55-4170-8e60-8dbdb012bb73-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-c6c59a04-bb55-4170-8e60-8dbdb012bb73-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "cinder-quobyte-c6c59a04-bb55-4170-8e60-8dbdb012bb73" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-quobyte-c6c59a04-bb55-4170-8e60-8dbdb012bb73" acquired by "delete_volume" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c34d9c-4851-4818-9d7e-ca160b6654a7]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:24 devstack sudo[111396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73 Jun 19 04:32:24 devstack sudo[111396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:25 devstack sudo[111396]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73" returned: 0 in 0.730s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:25 devstack sudo[111401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73 Jun 19 04:32:25 devstack sudo[111401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:26 devstack sudo[111401]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c6c59a04-bb55-4170-8e60-8dbdb012bb73" returned: 0 in 0.617s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-quobyte-c6c59a04-bb55-4170-8e60-8dbdb012bb73" released by "delete_volume" :: held 1.382s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Created reservations ['bdb516e1-2dde-4a57-b074-14d4b1c7adb5', '57839c57-1114-4a32-970e-3072441f53bc', 'c1222ed2-3140-4640-b383-dec6723ddcbd', '1e8046f2-ff78-4c35-b9bb-cf003c3daa5d'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:26 devstack sudo[111404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:32:26 devstack sudo[111404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:26 devstack sudo[111404]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.624s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:26 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Deleted volume successfully. Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2c832a75-f041-482d-9986-39e4ac838a6c tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-c6c59a04-bb55-4170-8e60-8dbdb012bb73-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "cinder-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "cinder-quobyte-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-quobyte-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2" acquired by "delete_volume" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef839c5-5d5b-4992-b1e9-1fcfb1bcf19d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:27 devstack sudo[111407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2 Jun 19 04:32:27 devstack sudo[111407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:27 devstack sudo[111407]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2" returned: 0 in 0.711s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:27 devstack sudo[111412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2 Jun 19 04:32:27 devstack sudo[111412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:28 devstack sudo[111412]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2" returned: 0 in 0.645s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:28 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-quobyte-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2" released by "delete_volume" :: held 1.394s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:28 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Created reservations ['981c1099-10c1-400b-9064-96260ce878b0', '41fbe434-0bbf-4770-9412-164727b7d319', '3c2306cc-c9ca-4c07-8843-e8b0e0a0d7af', '4ecf29ce-db3b-482e-8859-d5fc2de111c3'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:28 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:28 devstack sudo[111415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:32:28 devstack sudo[111415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:29 devstack sudo[111415]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.629s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:29 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:29 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Deleted volume successfully. Jun 19 04:32:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "cinder-5a7fe96f-abc9-4df8-be7e-92b0b44de929-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-42cdaf03-f0c0-4fc5-9853-4b83b10d05e0 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-7b5f2ea1-a565-491c-a0d3-a54405a3e0f2-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-5a7fe96f-abc9-4df8-be7e-92b0b44de929-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "cinder-quobyte-5a7fe96f-abc9-4df8-be7e-92b0b44de929" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:29 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-quobyte-5a7fe96f-abc9-4df8-be7e-92b0b44de929" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:29 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7584fc-b09a-4ce6-aa0d-1354d777e6e6]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:29 devstack sudo[111418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929 Jun 19 04:32:29 devstack sudo[111418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:29 devstack sudo[111418]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929" returned: 0 in 0.709s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:29 devstack sudo[111424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929 Jun 19 04:32:29 devstack sudo[111424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:30 devstack sudo[111424]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5a7fe96f-abc9-4df8-be7e-92b0b44de929" returned: 0 in 0.625s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:30 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-quobyte-5a7fe96f-abc9-4df8-be7e-92b0b44de929" released by "delete_volume" :: held 1.367s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:30 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Created reservations ['95ecfebf-a357-47f9-88f7-cde1b04bfdb5', 'f14761c3-6a47-4dfa-acac-bc41ab311f05', 'a103d9cd-52cd-46a3-a06a-850a245f14d1', '4708a49f-6335-48f6-bbcd-b4450a0a66c6'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:30 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:30 devstack sudo[111427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:32:30 devstack sudo[111427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:31 devstack sudo[111427]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.609s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:31 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:31 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Deleted volume successfully. Jun 19 04:32:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-03db64e9-b557-431e-8917-7a0efbd6ea2b tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-5a7fe96f-abc9-4df8-be7e-92b0b44de929-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "cinder-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "cinder-quobyte-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:31 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-quobyte-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e" acquired by "delete_volume" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:31 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1da2dab-efb8-4851-af70-a0064c6c11c5]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:31 devstack sudo[111430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e Jun 19 04:32:31 devstack sudo[111430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:32 devstack sudo[111430]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e" returned: 0 in 0.816s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:32 devstack sudo[111438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e Jun 19 04:32:32 devstack sudo[111438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:32 devstack sudo[111438]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e" returned: 0 in 0.677s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:32 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-quobyte-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e" released by "delete_volume" :: held 1.543s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:33 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Created reservations ['935d49bb-82bb-4d83-8151-067fa58912e1', 'c50a1e78-bf0e-4a5d-9fcd-38077747fcf3', 'bcc458c4-57bf-48cf-9f97-6e08f7d3b552', '679411e2-b370-44de-8cb0-3dd47e98aaba'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:33 devstack sudo[111441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:32:33 devstack sudo[111441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:34 devstack sudo[111441]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.988s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:34 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:34 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Deleted volume successfully. Jun 19 04:32:34 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8b44d70e-9693-4605-9582-fe76cff70f74 tempest-CreateVolumesFromSourceVolumeTest-1782323440 None] Lock "cinder-90e13a3a-ecf7-495e-8feb-3c31ec52aa9e-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Flow 'volume_create_manager' (afe1cec4-fae1-4b0b-b3ee-384b0de5739a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19167583-636b-432a-892d-5677901e5d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19167583-636b-432a-892d-5677901e5d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1731255556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cedf18b-70e8-4c5a-ab55-f19448ed8882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='638e1aeed8c94162b007823533fe10cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:37Z,use_quota=True,user_id='15765b2e2b83465b9518dbe237e5af7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48372958-e5fc-45c8-aeeb-58f6c91ac675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48372958-e5fc-45c8-aeeb-58f6c91ac675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (addf05f2-86ba-4794-bb6c-2486c35a4a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (addf05f2-86ba-4794-bb6c-2486c35a4a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cedf18b-70e8-4c5a-ab55-f19448ed8882', 'volume_name': 'volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1be346c-f9c1-4723-9ccc-37980b8b949a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1be346c-f9c1-4723-9ccc-37980b8b949a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e2073b-35d2-4804-9699-e2669b8db2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Volume 9cedf18b-70e8-4c5a-ab55-f19448ed8882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882', 'volume_size': 1} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1731255556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cedf18b-70e8-4c5a-ab55-f19448ed8882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='638e1aeed8c94162b007823533fe10cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:37Z,use_quota=True,user_id='15765b2e2b83465b9518dbe237e5af7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Creating volume 9cedf18b-70e8-4c5a-ab55-f19448ed8882 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:36 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:32:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:36 devstack sudo[111489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 1073741824 Jun 19 04:32:36 devstack sudo[111489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:37 devstack sudo[111489]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 1073741824" returned: 0 in 0.853s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:37 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=98,cinder:UPDATE=134,cinder:INSERT=40,cinder:DELETE=10 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:32:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:37 devstack sudo[111494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 Jun 19 04:32:37 devstack sudo[111494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:38 devstack sudo[111494]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882" returned: 0 in 0.672s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e2073b-35d2-4804-9699-e2669b8db2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241c50f7-55c3-4b49-a77f-cb0177a9b1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:38 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Volume volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 (9cedf18b-70e8-4c5a-ab55-f19448ed8882): created successfully Jun 19 04:32:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241c50f7-55c3-4b49-a77f-cb0177a9b1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Flow 'volume_create_manager' (afe1cec4-fae1-4b0b-b3ee-384b0de5739a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:38 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-0ffd1fb1-a42a-4c8d-a21e-c0fcb24c217c tempest-VolumeDependencyTests-156616992 None] Created volume successfully. Jun 19 04:32:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:39 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] Creating offline snapshot 9619dcd4-b29d-48e5-a431-e2fd2a6d292b of volume 9cedf18b-70e8-4c5a-ab55-f19448ed8882 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:32:39 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[992b8b2b-39c7-40b4-b2dc-22b0e853d9d1]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Acquiring lock "cinder-7fa4a0cb-ecd6-4260-a914-73957e0938a7-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Lock "cinder-7fa4a0cb-ecd6-4260-a914-73957e0938a7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Acquiring lock "cinder-quobyte-7fa4a0cb-ecd6-4260-a914-73957e0938a7" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:39 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Lock "cinder-quobyte-7fa4a0cb-ecd6-4260-a914-73957e0938a7" acquired by "delete_volume" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:39 devstack sudo[111497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 Jun 19 04:32:39 devstack sudo[111497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:39 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e4adb-a3d0-42dc-97ba-1195e03623dc]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:39 devstack sudo[111499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7 Jun 19 04:32:39 devstack sudo[111499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:39 devstack sudo[111497]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882" returned: 0 in 0.783s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:39 devstack sudo[111507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b 1G Jun 19 04:32:39 devstack sudo[111507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:39 devstack sudo[111499]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7" returned: 0 in 0.787s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:39 devstack sudo[111510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7 Jun 19 04:32:39 devstack sudo[111510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:40 devstack sudo[111507]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b 1G" returned: 0 in 0.772s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:40 devstack sudo[111516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b Jun 19 04:32:40 devstack sudo[111516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:40 devstack sudo[111510]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7fa4a0cb-ecd6-4260-a914-73957e0938a7" returned: 0 in 0.742s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Lock "cinder-quobyte-7fa4a0cb-ecd6-4260-a914-73957e0938a7" released by "delete_volume" :: held 1.568s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:40 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Created reservations ['594ee335-e32f-4575-99e1-2513481c52e7', '5ae29684-cb56-4db8-8e44-02dbe00fe7d4', 'c6df54c1-aa25-4a9a-9602-18bd0a14bcab', '653bca94-fbf0-421c-8294-cc5d0feea852'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:40 devstack sudo[111518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:32:40 devstack sudo[111518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:41 devstack sudo[111516]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b" returned: 0 in 0.734s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:41 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b is being set with open permissions: ugo+rw Jun 19 04:32:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:41 devstack sudo[111523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b Jun 19 04:32:41 devstack sudo[111523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:41 devstack sudo[111518]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.661s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:41 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:41 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Deleted volume successfully. Jun 19 04:32:41 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0a21a299-4423-46eb-bf80-8b7ac10a8125 tempest-TestStampPattern-1924381596 None] Lock "cinder-7fa4a0cb-ecd6-4260-a914-73957e0938a7-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:42 devstack sudo[111523]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b" returned: 0 in 0.724s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:42 devstack sudo[111527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.info Jun 19 04:32:42 devstack sudo[111527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:42 devstack sudo[111527]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.info" returned: 0 in 0.692s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:42 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.info is being set with open permissions: ugo+rw Jun 19 04:32:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:42 devstack sudo[111564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.info Jun 19 04:32:42 devstack sudo[111564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:43 devstack sudo[111564]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.info" returned: 0 in 0.673s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.483s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:43 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-830d5331-3119-4246-bb13-1d75a4e3545b tempest-VolumeDependencyTests-156616992 None] Create snapshot completed successfully Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Flow 'volume_create_manager' (2bc2069e-051f-4a16-8f5f-c653644ced3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d29445-267c-4e2a-a1f7-f8a868924726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d29445-267c-4e2a-a1f7-f8a868924726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1136047334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582e2a78-c715-40bc-9eaf-a39bd90d4b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='638e1aeed8c94162b007823533fe10cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9619dcd4-b29d-48e5-a431-e2fd2a6d292b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:45Z,use_quota=True,user_id='15765b2e2b83465b9518dbe237e5af7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3437f57-293f-453b-957f-920c1c48ce16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3437f57-293f-453b-957f-920c1c48ce16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08562a40-463c-4b47-9521-236cd64faea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08562a40-463c-4b47-9521-236cd64faea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '582e2a78-c715-40bc-9eaf-a39bd90d4b17', 'volume_name': 'volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17', 'volume_size': 1, 'snapshot_id': '9619dcd4-b29d-48e5-a431-e2fd2a6d292b'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6427bfa7-da89-4d19-80fc-688f8094efdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6427bfa7-da89-4d19-80fc-688f8094efdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c56e0b-c285-42e9-8c97-e00767a067e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:44 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Volume 582e2a78-c715-40bc-9eaf-a39bd90d4b17: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17', 'volume_size': 1, 'snapshot_id': '9619dcd4-b29d-48e5-a431-e2fd2a6d292b'} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Acquiring lock "cinder-quobyte-9619dcd4-b29d-48e5-a431-e2fd2a6d292b-582e2a78-c715-40bc-9eaf-a39bd90d4b17" by "_create_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Lock "cinder-quobyte-9619dcd4-b29d-48e5-a431-e2fd2a6d292b-582e2a78-c715-40bc-9eaf-a39bd90d4b17" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Creating volume 582e2a78-c715-40bc-9eaf-a39bd90d4b17 from snapshot 9619dcd4-b29d-48e5-a431-e2fd2a6d292b {{(pid=93300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:44 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Acquiring lock "cinder-quobyte-582e2a78-c715-40bc-9eaf-a39bd90d4b17" by "_copy_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Lock "cinder-quobyte-582e2a78-c715-40bc-9eaf-a39bd90d4b17" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] snapshot: 9619dcd4-b29d-48e5-a431-e2fd2a6d292b, volume: 582e2a78-c715-40bc-9eaf-a39bd90d4b17, {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf4c2e-bec3-4e3e-99d7-61ccc09b7dd7]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:45 devstack sudo[111570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b Jun 19 04:32:45 devstack sudo[111570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:45 devstack sudo[111570]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b" returned: 0 in 0.817s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Creating direct copy from snapshot {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ae92de-2d9a-4629-a1d9-064c3e85a93a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:46 devstack sudo[111576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 Jun 19 04:32:46 devstack sudo[111576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:46 devstack sudo[111576]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882" returned: 0 in 0.784s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:46 devstack cinder-volume[93300]: DEBUG cinder.utils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Path /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17 not found in is_blk_device check {{(pid=93300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:32:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:46 devstack sudo[111581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17 Jun 19 04:32:46 devstack sudo[111581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:52 devstack sudo[111581]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17" returned: 0 in 5.700s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:52 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[04daf1e5-0dc9-48c1-90df-3124c0d7fd0e]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:52 devstack sudo[111597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 Jun 19 04:32:52 devstack sudo[111597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:53 devstack sudo[111597]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882" returned: 0 in 0.939s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:53 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:32:53 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Converted 1024.00 MB image at 179.63 MB/s Jun 19 04:32:53 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17 is being set with open permissions: ugo+rw Jun 19 04:32:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:53 devstack sudo[111602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17 Jun 19 04:32:53 devstack sudo[111602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:53 devstack sudo[111602]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17" returned: 0 in 0.618s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Lock "cinder-quobyte-582e2a78-c715-40bc-9eaf-a39bd90d4b17" released by "_copy_volume_from_snapshot" :: held 8.992s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Lock "cinder-quobyte-9619dcd4-b29d-48e5-a431-e2fd2a6d292b-582e2a78-c715-40bc-9eaf-a39bd90d4b17" released by "_create_volume_from_snapshot" :: held 9.027s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.043s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c56e0b-c285-42e9-8c97-e00767a067e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17', 'volume_size': 1, 'snapshot_id': '9619dcd4-b29d-48e5-a431-e2fd2a6d292b'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1d534e-1c4b-4d5d-8e13-a413f9712d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:54 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Volume volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17 (582e2a78-c715-40bc-9eaf-a39bd90d4b17): created successfully Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1d534e-1c4b-4d5d-8e13-a413f9712d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Flow 'volume_create_manager' (2bc2069e-051f-4a16-8f5f-c653644ced3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:54 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8c15ef5e-4a59-4614-9007-8b44f370aa1e tempest-VolumeDependencyTests-156616992 None] Created volume successfully. Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Acquiring lock "cinder-9619dcd4-b29d-48e5-a431-e2fd2a6d292b-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Lock "cinder-9619dcd4-b29d-48e5-a431-e2fd2a6d292b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Acquiring lock "cinder-quobyte-9cedf18b-70e8-4c5a-ab55-f19448ed8882" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Lock "cinder-quobyte-9cedf18b-70e8-4c5a-ab55-f19448ed8882" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Acquiring lock "cinder-quobyte-9619dcd4-b29d-48e5-a431-e2fd2a6d292b" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Lock "cinder-quobyte-9619dcd4-b29d-48e5-a431-e2fd2a6d292b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Deleting offline snapshot 9619dcd4-b29d-48e5-a431-e2fd2a6d292b of volume 9cedf18b-70e8-4c5a-ab55-f19448ed8882 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] snapshot_file for this snap is: volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c952a4-8cb3-46f4-9d8a-692a63802731]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:54 devstack sudo[111605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b Jun 19 04:32:54 devstack sudo[111605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:55 devstack sudo[111605]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b" returned: 0 in 0.732s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:32:55 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7baba8f-a4b1-4ba5-9af9-104b7b2867b4]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:55 devstack sudo[111610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 Jun 19 04:32:55 devstack sudo[111610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:56 devstack sudo[111610]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882" returned: 0 in 0.714s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:56 devstack sudo[111615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b Jun 19 04:32:56 devstack sudo[111615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:57 devstack sudo[111615]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b" returned: 0 in 0.695s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:57 devstack sudo[111620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b Jun 19 04:32:57 devstack sudo[111620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:57 devstack sudo[111620]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882.9619dcd4-b29d-48e5-a431-e2fd2a6d292b" returned: 0 in 0.611s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Lock "cinder-quobyte-9619dcd4-b29d-48e5-a431-e2fd2a6d292b" released by "_delete_snapshot" :: held 2.850s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Lock "cinder-quobyte-9cedf18b-70e8-4c5a-ab55-f19448ed8882" released by "delete_snapshot" :: held 2.871s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:57 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Created reservations ['067a8e05-8553-4634-bdb1-e3ccc2450acb', '394c9f68-0931-4410-9160-735d980fd00a', 'e7a31726-6bcd-4c8c-b8ce-177af158223d', 'af8aeae2-616c-4094-b9b1-329777bdd467'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:57 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Delete snapshot completed successfully. Jun 19 04:32:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ee250d56-1e5e-400c-ad75-3989e929068f tempest-VolumeDependencyTests-156616992 None] Lock "cinder-9619dcd4-b29d-48e5-a431-e2fd2a6d292b-delete_snapshot" released by "delete_snapshot" :: held 3.002s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Acquiring lock "cinder-9cedf18b-70e8-4c5a-ab55-f19448ed8882-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Lock "cinder-9cedf18b-70e8-4c5a-ab55-f19448ed8882-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Acquiring lock "cinder-quobyte-9cedf18b-70e8-4c5a-ab55-f19448ed8882" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Lock "cinder-quobyte-9cedf18b-70e8-4c5a-ab55-f19448ed8882" acquired by "delete_volume" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:58 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d38cc7-7570-4fb7-880b-0ae5592a1dfd]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:58 devstack sudo[111623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 Jun 19 04:32:58 devstack sudo[111623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:58 devstack sudo[111623]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882" returned: 0 in 0.751s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:58 devstack sudo[111629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882 Jun 19 04:32:58 devstack sudo[111629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:59 devstack sudo[111629]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-9cedf18b-70e8-4c5a-ab55-f19448ed8882" returned: 0 in 0.605s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Lock "cinder-quobyte-9cedf18b-70e8-4c5a-ab55-f19448ed8882" released by "delete_volume" :: held 1.411s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:59 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Created reservations ['767c67da-3717-498e-90e6-d2df99f3c511', 'a2e8a2b0-c09d-4d1e-be39-7434d3857cae', '1714880c-c377-4b40-9b3e-deadf7f297ae', '3dcb1f35-73df-449b-9d03-42ccf1202bde'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:59 devstack sudo[111632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:32:59 devstack sudo[111632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:00 devstack sudo[111632]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.608s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:00 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:00 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Deleted volume successfully. Jun 19 04:33:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-2ae2c405-933c-410a-ab11-c03e5960033a tempest-VolumeDependencyTests-156616992 None] Lock "cinder-9cedf18b-70e8-4c5a-ab55-f19448ed8882-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Acquiring lock "cinder-582e2a78-c715-40bc-9eaf-a39bd90d4b17-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Lock "cinder-582e2a78-c715-40bc-9eaf-a39bd90d4b17-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Acquiring lock "cinder-quobyte-582e2a78-c715-40bc-9eaf-a39bd90d4b17" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Lock "cinder-quobyte-582e2a78-c715-40bc-9eaf-a39bd90d4b17" acquired by "delete_volume" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:00 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa15b040-4cb3-4872-992f-19c1d08194ef]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:00 devstack sudo[111636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17 Jun 19 04:33:00 devstack sudo[111636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:00 devstack sudo[111636]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17" returned: 0 in 0.717s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:01 devstack sudo[111641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17 Jun 19 04:33:01 devstack sudo[111641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:01 devstack sudo[111641]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-582e2a78-c715-40bc-9eaf-a39bd90d4b17" returned: 0 in 0.606s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:01 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Lock "cinder-quobyte-582e2a78-c715-40bc-9eaf-a39bd90d4b17" released by "delete_volume" :: held 1.361s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:01 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Created reservations ['c52eb0e1-3684-43a9-9e08-11dc566a7aab', 'c2298def-081d-4767-8abd-fb1d2c75e6a8', '96b66953-9dab-4829-81f8-efded0ce12a5', '18d95da1-35b7-490e-bc65-ee5189f58e5d'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:01 devstack sudo[111644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:33:01 devstack sudo[111644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:02 devstack sudo[111644]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.617s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:02 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:02 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Deleted volume successfully. Jun 19 04:33:02 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-936a2102-a9e4-4d2b-9fc7-9996ee77e7b2 tempest-VolumeDependencyTests-156616992 None] Lock "cinder-582e2a78-c715-40bc-9eaf-a39bd90d4b17-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Flow 'volume_create_manager' (8a757a20-8aa3-4b31-a4ad-e9158943ca2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632a4093-77a5-4903-ada4-f31ad21f54c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632a4093-77a5-4903-ada4-f31ad21f54c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c233bd60-1c7e-4741-9974-0b424e7d7993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c135e1da41466fb581fbe71f63c8eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:05Z,use_quota=True,user_id='2440d0fd166841f899650e4ed2dba9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58813416-9517-4cc9-a53c-5b72e9fbc64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58813416-9517-4cc9-a53c-5b72e9fbc64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2422b997-e45e-4da7-8c97-13d306a182e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2422b997-e45e-4da7-8c97-13d306a182e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c233bd60-1c7e-4741-9974-0b424e7d7993', 'volume_name': 'volume-c233bd60-1c7e-4741-9974-0b424e7d7993', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09c6c33-b4dd-451b-bfcf-d9e872678a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09c6c33-b4dd-451b-bfcf-d9e872678a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b847f885-153d-4a70-807d-fabb8934b270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:05 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Volume c233bd60-1c7e-4741-9974-0b424e7d7993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c233bd60-1c7e-4741-9974-0b424e7d7993', 'volume_size': 1} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c233bd60-1c7e-4741-9974-0b424e7d7993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c135e1da41466fb581fbe71f63c8eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:05Z,use_quota=True,user_id='2440d0fd166841f899650e4ed2dba9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Creating volume c233bd60-1c7e-4741-9974-0b424e7d7993 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:05 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c233bd60-1c7e-4741-9974-0b424e7d7993 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:05 devstack sudo[111647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c233bd60-1c7e-4741-9974-0b424e7d7993 1073741824 Jun 19 04:33:05 devstack sudo[111647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:05 devstack sudo[111647]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c233bd60-1c7e-4741-9974-0b424e7d7993 1073741824" returned: 0 in 0.777s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c233bd60-1c7e-4741-9974-0b424e7d7993 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:05 devstack sudo[111652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c233bd60-1c7e-4741-9974-0b424e7d7993 Jun 19 04:33:05 devstack sudo[111652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:06 devstack sudo[111652]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c233bd60-1c7e-4741-9974-0b424e7d7993" returned: 0 in 0.665s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b847f885-153d-4a70-807d-fabb8934b270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c233bd60-1c7e-4741-9974-0b424e7d7993', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b58543-b7e2-4dc3-a3c7-4ff1c94d6049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:06 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Volume volume-c233bd60-1c7e-4741-9974-0b424e7d7993 (c233bd60-1c7e-4741-9974-0b424e7d7993): created successfully Jun 19 04:33:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b58543-b7e2-4dc3-a3c7-4ff1c94d6049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Flow 'volume_create_manager' (8a757a20-8aa3-4b31-a4ad-e9158943ca2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:06 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-129586cf-11a0-4b98-919d-722dbc2284a5 tempest-CinderUnicodeTest-237422109 None] Created volume successfully. Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Flow 'volume_create_manager' (e6ce7ac8-3c8f-437e-81f0-de6558c8ab35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab71ad3-1273-42ba-8158-7961c7eeaf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab71ad3-1273-42ba-8158-7961c7eeaf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1605789825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c013bd-8607-4f79-8a34-da47b46e406c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c135e1da41466fb581fbe71f63c8eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:08Z,use_quota=True,user_id='2440d0fd166841f899650e4ed2dba9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b47f25-e7ac-4356-9caf-76232c4e7a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b47f25-e7ac-4356-9caf-76232c4e7a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9b0fdf-27a2-4ca0-907c-18076627ce25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9b0fdf-27a2-4ca0-907c-18076627ce25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c013bd-8607-4f79-8a34-da47b46e406c', 'volume_name': 'volume-c4c013bd-8607-4f79-8a34-da47b46e406c', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca734c74-214f-4ea6-baf4-e5ccb1dc39aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca734c74-214f-4ea6-baf4-e5ccb1dc39aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9920d9b-36da-45cb-b765-7eafecc47ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Volume c4c013bd-8607-4f79-8a34-da47b46e406c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c013bd-8607-4f79-8a34-da47b46e406c', 'volume_size': 1} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1605789825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c013bd-8607-4f79-8a34-da47b46e406c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c135e1da41466fb581fbe71f63c8eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:08Z,use_quota=True,user_id='2440d0fd166841f899650e4ed2dba9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Creating volume c4c013bd-8607-4f79-8a34-da47b46e406c {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:07 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:07 devstack sudo[111655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c 1073741824 Jun 19 04:33:07 devstack sudo[111655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:08 devstack sudo[111655]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c 1073741824" returned: 0 in 0.863s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:08 devstack sudo[111663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c Jun 19 04:33:08 devstack sudo[111663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:09 devstack sudo[111663]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c" returned: 0 in 0.608s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9920d9b-36da-45cb-b765-7eafecc47ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c013bd-8607-4f79-8a34-da47b46e406c', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebb4df6-7059-414c-8b98-403efbdb4765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:09 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Volume volume-c4c013bd-8607-4f79-8a34-da47b46e406c (c4c013bd-8607-4f79-8a34-da47b46e406c): created successfully Jun 19 04:33:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebb4df6-7059-414c-8b98-403efbdb4765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:09 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Flow 'volume_create_manager' (e6ce7ac8-3c8f-437e-81f0-de6558c8ab35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:09 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-5df8765e-3c53-4476-8a02-defb14a0ea57 tempest-CinderUnicodeTest-237422109 None] Created volume successfully. Jun 19 04:33:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] Creating offline snapshot 622e6c4f-7688-4455-a0ff-913a80ed33b4 of volume c4c013bd-8607-4f79-8a34-da47b46e406c {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:33:09 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa39881c-1f7e-4f40-8571-121152fe2869]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:10 devstack sudo[111667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c Jun 19 04:33:10 devstack sudo[111667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:10 devstack sudo[111667]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c" returned: 0 in 0.726s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:10 devstack sudo[111672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 1G Jun 19 04:33:10 devstack sudo[111672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:11 devstack sudo[111672]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 1G" returned: 0 in 0.777s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c013bd-8607-4f79-8a34-da47b46e406c -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:11 devstack sudo[111677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c013bd-8607-4f79-8a34-da47b46e406c -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 Jun 19 04:33:11 devstack sudo[111677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:12 devstack sudo[111677]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c013bd-8607-4f79-8a34-da47b46e406c -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4" returned: 0 in 0.645s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:12 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 is being set with open permissions: ugo+rw Jun 19 04:33:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:12 devstack sudo[111682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 Jun 19 04:33:12 devstack sudo[111682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:12 devstack sudo[111682]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4" returned: 0 in 0.620s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:12 devstack sudo[111685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.info Jun 19 04:33:12 devstack sudo[111685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:13 devstack sudo[111685]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.info" returned: 0 in 0.619s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:13 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.info is being set with open permissions: ugo+rw Jun 19 04:33:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:13 devstack sudo[111688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.info Jun 19 04:33:13 devstack sudo[111688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:14 devstack sudo[111688]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.info" returned: 0 in 0.637s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.114s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:14 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d2e17cc5-1e6c-482d-b191-0211be5675ce tempest-CinderUnicodeTest-237422109 None] Create snapshot completed successfully Jun 19 04:33:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Acquiring lock "cinder-622e6c4f-7688-4455-a0ff-913a80ed33b4-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-622e6c4f-7688-4455-a0ff-913a80ed33b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Acquiring lock "cinder-quobyte-c4c013bd-8607-4f79-8a34-da47b46e406c" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-quobyte-c4c013bd-8607-4f79-8a34-da47b46e406c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Acquiring lock "cinder-quobyte-622e6c4f-7688-4455-a0ff-913a80ed33b4" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-quobyte-622e6c4f-7688-4455-a0ff-913a80ed33b4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Deleting offline snapshot 622e6c4f-7688-4455-a0ff-913a80ed33b4 of volume c4c013bd-8607-4f79-8a34-da47b46e406c {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:33:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] snapshot_file for this snap is: volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:33:15 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[530ce966-d267-44a9-9b67-20e926aeb0c8]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:15 devstack sudo[111692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 Jun 19 04:33:15 devstack sudo[111692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:15 devstack sudo[111692]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4" returned: 0 in 0.752s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c013bd-8607-4f79-8a34-da47b46e406c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:33:16 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbb3591-dc96-45ca-8b11-baeb12c772b7]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:16 devstack sudo[111697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c Jun 19 04:33:16 devstack sudo[111697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:16 devstack sudo[111697]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c" returned: 0 in 0.716s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:16 devstack sudo[111704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 Jun 19 04:33:16 devstack sudo[111704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:17 devstack sudo[111704]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4" returned: 0 in 0.707s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:17 devstack sudo[111709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4 Jun 19 04:33:17 devstack sudo[111709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:18 devstack sudo[111709]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c.622e6c4f-7688-4455-a0ff-913a80ed33b4" returned: 0 in 0.612s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:18 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=96,cinder:DELETE=7,cinder:SELECT=69,cinder:INSERT=19 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:33:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-quobyte-622e6c4f-7688-4455-a0ff-913a80ed33b4" released by "_delete_snapshot" :: held 2.886s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-quobyte-c4c013bd-8607-4f79-8a34-da47b46e406c" released by "delete_snapshot" :: held 2.911s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:18 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Created reservations ['663db228-3ee6-45de-8cbe-325a68693de1', 'e280273f-5595-4ddc-b38b-2e0d278405db', 'd57906f6-1c07-46d3-ae62-5844e2b562bd', '67904add-6eda-4ec0-8d21-8355a31530f1'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:18 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Delete snapshot completed successfully. Jun 19 04:33:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6865f0d6-aa16-491f-b625-c7c87f024f51 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-622e6c4f-7688-4455-a0ff-913a80ed33b4-delete_snapshot" released by "delete_snapshot" :: held 3.076s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Acquiring lock "cinder-c4c013bd-8607-4f79-8a34-da47b46e406c-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-c4c013bd-8607-4f79-8a34-da47b46e406c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Acquiring lock "cinder-quobyte-c4c013bd-8607-4f79-8a34-da47b46e406c" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:18 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-quobyte-c4c013bd-8607-4f79-8a34-da47b46e406c" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:18 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3f3c42-4fef-4233-8d47-a007411bf592]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:18 devstack sudo[111712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c Jun 19 04:33:18 devstack sudo[111712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:19 devstack sudo[111712]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c" returned: 0 in 0.779s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:19 devstack sudo[111717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:33:19 devstack sudo[111717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:19 devstack sudo[111718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c Jun 19 04:33:19 devstack sudo[111718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:19 devstack sudo[111718]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c4c013bd-8607-4f79-8a34-da47b46e406c" returned: 0 in 0.622s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-quobyte-c4c013bd-8607-4f79-8a34-da47b46e406c" released by "delete_volume" :: held 1.461s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:19 devstack sudo[111717]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.670s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 29 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Created reservations ['02a0c724-090d-475f-bced-7854880e15a3', '5ca7e378-821c-4520-be68-65626ac8d38c', '9c86dacf-a9e7-4115-90e4-150ac3452b99', '04758508-d85e-4d36-9a3f-64dd60af94ac'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:20 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:20 devstack sudo[111724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:33:20 devstack sudo[111724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Acquiring lock "cinder-c233bd60-1c7e-4741-9974-0b424e7d7993-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-c233bd60-1c7e-4741-9974-0b424e7d7993-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:20 devstack sudo[111724]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.628s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:20 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Acquiring lock "cinder-quobyte-c233bd60-1c7e-4741-9974-0b424e7d7993" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:20 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Deleted volume successfully. Jun 19 04:33:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-quobyte-c233bd60-1c7e-4741-9974-0b424e7d7993" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:20 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f5790bfc-2340-4714-b7fc-0a9661e31b40 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-c4c013bd-8607-4f79-8a34-da47b46e406c-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:20 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d7df2d-ff85-4ebe-a514-65f005446f72]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c233bd60-1c7e-4741-9974-0b424e7d7993 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:20 devstack sudo[111727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c233bd60-1c7e-4741-9974-0b424e7d7993 Jun 19 04:33:20 devstack sudo[111727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:21 devstack sudo[111727]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c233bd60-1c7e-4741-9974-0b424e7d7993" returned: 0 in 0.751s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c233bd60-1c7e-4741-9974-0b424e7d7993 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:21 devstack sudo[111733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c233bd60-1c7e-4741-9974-0b424e7d7993 Jun 19 04:33:21 devstack sudo[111733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:22 devstack sudo[111733]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c233bd60-1c7e-4741-9974-0b424e7d7993" returned: 0 in 0.629s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-quobyte-c233bd60-1c7e-4741-9974-0b424e7d7993" released by "delete_volume" :: held 1.420s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:22 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Created reservations ['547f0b1c-f684-42ca-8a4b-b8a8c3ba943c', '38e29145-b14b-4338-8b0e-82a0bcf8f23f', '3cfe3196-17cc-4735-88fb-a4cebf69cef5', 'fd5cc368-6c56-4318-b127-d4dace80ba73'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:22 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:22 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:22 devstack sudo[111736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:33:22 devstack sudo[111736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:22 devstack sudo[111736]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.622s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:22 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:22 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Deleted volume successfully. Jun 19 04:33:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dde9db44-538f-4740-bfa2-8b43c09fc0f4 tempest-CinderUnicodeTest-237422109 None] Lock "cinder-c233bd60-1c7e-4741-9974-0b424e7d7993-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:32 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=12,cinder:INSERT=8,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:33:32 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:UPDATE=70,cinder:DELETE=8,cinder:SELECT=49,cinder:INSERT=16 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Flow 'volume_create_manager' (3d422556-60e3-4275-890b-90c4e650f250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e306fd8-8e47-49a8-a48c-7b4775271fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e306fd8-8e47-49a8-a48c-7b4775271fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed58a39f-5da3-46ec-8f1b-2dc23fdd0223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768498c166364af2a306c71ef30b14b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:35Z,use_quota=True,user_id='026ce9c8a0d846d1b1177ef3a414e8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3be509f-4395-483b-9c4e-46542f8bc9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3be509f-4395-483b-9c4e-46542f8bc9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2af68e-745d-4443-bb3a-2bdbf2cc153a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2af68e-745d-4443-bb3a-2bdbf2cc153a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed58a39f-5da3-46ec-8f1b-2dc23fdd0223', 'volume_name': 'volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695af254-51d1-4d4d-be61-e7d090f97e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695af254-51d1-4d4d-be61-e7d090f97e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d0ee06-2ac6-4e33-b73d-562602e91c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:34 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Volume ed58a39f-5da3-46ec-8f1b-2dc23fdd0223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223', 'volume_size': 1} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed58a39f-5da3-46ec-8f1b-2dc23fdd0223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768498c166364af2a306c71ef30b14b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:35Z,use_quota=True,user_id='026ce9c8a0d846d1b1177ef3a414e8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Creating volume ed58a39f-5da3-46ec-8f1b-2dc23fdd0223 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:34 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:34 devstack sudo[111784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223 1073741824 Jun 19 04:33:34 devstack sudo[111784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:34 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Flow 'volume_create_manager' (5e282db9-a34f-4520-bfd3-fa1e6b8a86d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f2c733-09f9-427d-8a88-d527593b0c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f2c733-09f9-427d-8a88-d527593b0c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935924929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b5b5f8-188b-483f-aa3f-935c26d27c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa838cb610454abcb162d0ad6f53ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:35Z,use_quota=True,user_id='ace0ae93a6c84e2fb65ac305a5149a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3387c1-7269-42a6-a01e-ee68b97ff90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3387c1-7269-42a6-a01e-ee68b97ff90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97486822-8fe1-4a8d-bfc3-87f6e56eb09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97486822-8fe1-4a8d-bfc3-87f6e56eb09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b5b5f8-188b-483f-aa3f-935c26d27c13', 'volume_name': 'volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f57e0e5-83d4-445f-8183-32d93db5918d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f57e0e5-83d4-445f-8183-32d93db5918d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d130c2-3e04-453b-88bf-884e8dfbfa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume c7b5b5f8-188b-483f-aa3f-935c26d27c13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13', 'volume_size': 1} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Flow 'volume_create_manager' (8dff030f-a985-49fe-8b91-0accc00fcf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547b9aed-c070-4b7d-949d-8e6bda94e1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547b9aed-c070-4b7d-949d-8e6bda94e1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938341404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c2f4bc-3dac-413f-ace6-cf2d1b5a429e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de28a97e3ee247ce9b72432925b18541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:35Z,use_quota=True,user_id='e9a93142389041a5bd30e6b50ae90b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edaa91f2-505f-4e05-9019-18c91c41f564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edaa91f2-505f-4e05-9019-18c91c41f564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f8b032-94e5-467f-9855-dcc8629d5b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f8b032-94e5-467f-9855-dcc8629d5b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96c2f4bc-3dac-413f-ace6-cf2d1b5a429e', 'volume_name': 'volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c152dde5-e176-4464-bb77-adbc84b48e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c152dde5-e176-4464-bb77-adbc84b48e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088dbce9-efdf-455c-b1b5-5d2a3dc0cd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Volume 96c2f4bc-3dac-413f-ace6-cf2d1b5a429e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e', 'volume_size': 1} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:35 devstack sudo[111784]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Flow 'volume_create_manager' (95dabcd5-c508-4f67-922f-15d1662f7db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48ef082-26ef-4cb8-a3b9-1942139b4c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223 1073741824" returned: 0 in 1.128s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48ef082-26ef-4cb8-a3b9-1942139b4c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-836940206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de116d39-9b06-4f9a-91f4-ccb33855f841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de28a97e3ee247ce9b72432925b18541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:36Z,use_quota=True,user_id='e9a93142389041a5bd30e6b50ae90b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0b75aa-3908-4372-b075-369c0c12986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0b75aa-3908-4372-b075-369c0c12986f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34749546-c27c-4b94-8154-42eeb385b803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34749546-c27c-4b94-8154-42eeb385b803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de116d39-9b06-4f9a-91f4-ccb33855f841', 'volume_name': 'volume-de116d39-9b06-4f9a-91f4-ccb33855f841', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85587b58-1ef1-432b-82ee-1a71d6aa9726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85587b58-1ef1-432b-82ee-1a71d6aa9726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fddbe3d7-37cf-49b9-8d07-bdfe7ee56be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:35 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Volume de116d39-9b06-4f9a-91f4-ccb33855f841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de116d39-9b06-4f9a-91f4-ccb33855f841', 'volume_size': 1} Jun 19 04:33:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:36 devstack sudo[111789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223 Jun 19 04:33:36 devstack sudo[111789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Flow 'volume_create_manager' (5a22fc72-672f-4074-94ed-1c2d4f0526db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074c7674-c1cf-4b27-a701-2c98cdb53cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074c7674-c1cf-4b27-a701-2c98cdb53cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2049235019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902563d5-0bc6-4462-9765-c854501db3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de28a97e3ee247ce9b72432925b18541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:36Z,use_quota=True,user_id='e9a93142389041a5bd30e6b50ae90b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d65ff34-f088-465d-bba6-a8e6b9470d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d65ff34-f088-465d-bba6-a8e6b9470d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8615bbef-f266-4b71-82e2-062ba7befc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8615bbef-f266-4b71-82e2-062ba7befc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '902563d5-0bc6-4462-9765-c854501db3a3', 'volume_name': 'volume-902563d5-0bc6-4462-9765-c854501db3a3', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807754e-0d68-479c-9a7a-9e610d7751fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807754e-0d68-479c-9a7a-9e610d7751fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d504c9de-2c6c-44a6-8052-c35323db2f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:36 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Volume 902563d5-0bc6-4462-9765-c854501db3a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-902563d5-0bc6-4462-9765-c854501db3a3', 'volume_size': 1} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:36 devstack sudo[111789]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223" returned: 0 in 0.817s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.737s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935924929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b5b5f8-188b-483f-aa3f-935c26d27c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa838cb610454abcb162d0ad6f53ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:35Z,use_quota=True,user_id='ace0ae93a6c84e2fb65ac305a5149a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Creating volume c7b5b5f8-188b-483f-aa3f-935c26d27c13 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:36 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Flow 'volume_create_manager' (e8ca85b8-db39-4a83-9a42-5388dfa23e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:36 devstack sudo[111792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13 1073741824 Jun 19 04:33:36 devstack sudo[111792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8982f079-f714-4ee5-8aca-c5c7a99e729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d0ee06-2ac6-4e33-b73d-562602e91c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de06dc30-05d6-4305-89bd-782983e124e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8982f079-f714-4ee5-8aca-c5c7a99e729e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635385171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393a6ec1-0cae-4d14-8d1c-d40cc62fae64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de28a97e3ee247ce9b72432925b18541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:37Z,use_quota=True,user_id='e9a93142389041a5bd30e6b50ae90b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6f91de-dedf-4ce7-a461-19e0ead239bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6f91de-dedf-4ce7-a461-19e0ead239bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207b54ab-da71-4a9e-a206-572d98a367c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207b54ab-da71-4a9e-a206-572d98a367c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '393a6ec1-0cae-4d14-8d1c-d40cc62fae64', 'volume_name': 'volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10a2207-a0a8-4112-8a7e-27dd933295ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10a2207-a0a8-4112-8a7e-27dd933295ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0d70af-97d6-4346-a534-775997d18105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:37 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Volume 393a6ec1-0cae-4d14-8d1c-d40cc62fae64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64', 'volume_size': 1} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:37 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Volume volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223 (ed58a39f-5da3-46ec-8f1b-2dc23fdd0223): created successfully Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de06dc30-05d6-4305-89bd-782983e124e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Flow 'volume_create_manager' (3d422556-60e3-4275-890b-90c4e650f250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:37 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-2317c2a1-a61e-4fa5-b7b0-f224b2ee3d6e tempest-CinderUnicodeTest-281503540 None] Created volume successfully. Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Flow 'volume_create_manager' (ddcd64f5-de62-4063-8313-0270445a0a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073fd8dc-e4e7-4558-b61f-e5653093fd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073fd8dc-e4e7-4558-b61f-e5653093fd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1817643228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463d19b6-2ab8-45a6-ab25-6d52ae75eac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de28a97e3ee247ce9b72432925b18541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:37Z,use_quota=True,user_id='e9a93142389041a5bd30e6b50ae90b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09e7591-34c3-4fda-b3d1-1db0f5e5bc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09e7591-34c3-4fda-b3d1-1db0f5e5bc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad84807-af7e-45c5-8e1d-d49ed38407d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad84807-af7e-45c5-8e1d-d49ed38407d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463d19b6-2ab8-45a6-ab25-6d52ae75eac7', 'volume_name': 'volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca44d216-7d76-44ce-9e1b-6b99e397980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca44d216-7d76-44ce-9e1b-6b99e397980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a93b27-f330-4dda-9ddd-5057f2ada7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:37 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Volume 463d19b6-2ab8-45a6-ab25-6d52ae75eac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7', 'volume_size': 1} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:37 devstack sudo[111792]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13 1073741824" returned: 0 in 1.028s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:37 devstack sudo[111798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13 Jun 19 04:33:37 devstack sudo[111798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:38 devstack sudo[111798]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13" returned: 0 in 0.769s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.185s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938341404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c2f4bc-3dac-413f-ace6-cf2d1b5a429e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de28a97e3ee247ce9b72432925b18541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:35Z,use_quota=True,user_id='e9a93142389041a5bd30e6b50ae90b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Creating volume 96c2f4bc-3dac-413f-ace6-cf2d1b5a429e {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:38 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d130c2-3e04-453b-88bf-884e8dfbfa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:38 devstack sudo[111801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e 1073741824 Jun 19 04:33:38 devstack sudo[111801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8792b30-2f49-4b06-975c-ad21d07018e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:38 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13 (c7b5b5f8-188b-483f-aa3f-935c26d27c13): created successfully Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8792b30-2f49-4b06-975c-ad21d07018e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Flow 'volume_create_manager' (5e282db9-a34f-4520-bfd3-fa1e6b8a86d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:38 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b47d3242-39d9-4822-905f-39a11d9fea27 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Created volume successfully. Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Flow 'volume_create_manager' (723ee207-7912-4e50-a078-acc413dede4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a69a2e-b4b7-49fa-bc5b-42085a40305c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a69a2e-b4b7-49fa-bc5b-42085a40305c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2129697037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333821f2-4dc1-4ddf-8e95-10808b002eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768498c166364af2a306c71ef30b14b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:39Z,use_quota=True,user_id='026ce9c8a0d846d1b1177ef3a414e8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24e92bd-eef5-4dcc-806f-6512c803408c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24e92bd-eef5-4dcc-806f-6512c803408c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551684e6-b457-471c-a5f4-585484695ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551684e6-b457-471c-a5f4-585484695ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '333821f2-4dc1-4ddf-8e95-10808b002eaf', 'volume_name': 'volume-333821f2-4dc1-4ddf-8e95-10808b002eaf', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbbbe29-fe3c-47fc-b734-ffc381a07fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbbbe29-fe3c-47fc-b734-ffc381a07fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6cbf9dd-c829-4ee3-90a1-67a824639f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:38 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Volume 333821f2-4dc1-4ddf-8e95-10808b002eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-333821f2-4dc1-4ddf-8e95-10808b002eaf', 'volume_size': 1} Jun 19 04:33:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Flow 'volume_create_manager' (1759a65c-8623-48d7-a61b-2153fff2fce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585a298c-86e4-4f03-bd20-f8cd989e3265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585a298c-86e4-4f03-bd20-f8cd989e3265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfdad3b-8e43-4441-b8a6-5e338e3602af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d80b65088a4a84ae40db23b0d35ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:39Z,use_quota=True,user_id='d178f630fb4c4c1bbbb9eff8e338b68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e80f49-eff9-4477-8212-0a37098b60ee),volume_type_id=d3e80f49-eff9-4477-8212-0a37098b60ee)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2280ab29-2624-4735-b233-f26b035cd9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2280ab29-2624-4735-b233-f26b035cd9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe06337-aa05-4ce9-8f38-be26acb5780a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.image.glance [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Creating Keystone auth plugin from conf {{(pid=93300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe06337-aa05-4ce9-8f38-be26acb5780a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7cfdad3b-8e43-4441-b8a6-5e338e3602af', 'volume_name': 'volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af', 'volume_size': 1, 'image_id': '3d27f814-8c58-4aba-bee9-e8a4de8f9438', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d27f814-8c58-4aba-bee9-e8a4de8f9438', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '17c18ad446f6a1967e598179abffa401', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '94d80b65088a4a84ae40db23b0d35ff2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34d6928bd1daf02ea9f0ab4aa0143c9cdfc5b2706fd649b012ef3d76d1dbd6b694b271b0213b3c86081e069817a42df0e7000e250e603b24ce2837be58f2cd17', 'id': '3d27f814-8c58-4aba-bee9-e8a4de8f9438', 'created_at': datetime.datetime(2026, 6, 19, 2, 33, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 33, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d27f814-8c58-4aba-bee9-e8a4de8f9438/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8468582-a0ac-4869-a4ec-ced6c729be75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8468582-a0ac-4869-a4ec-ced6c729be75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a326f6f-d1ab-4607-ba17-3bd0d6b63dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:39 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Volume 7cfdad3b-8e43-4441-b8a6-5e338e3602af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af', 'volume_size': 1, 'image_id': '3d27f814-8c58-4aba-bee9-e8a4de8f9438', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d27f814-8c58-4aba-bee9-e8a4de8f9438', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '17c18ad446f6a1967e598179abffa401', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '94d80b65088a4a84ae40db23b0d35ff2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34d6928bd1daf02ea9f0ab4aa0143c9cdfc5b2706fd649b012ef3d76d1dbd6b694b271b0213b3c86081e069817a42df0e7000e250e603b24ce2837be58f2cd17', 'id': '3d27f814-8c58-4aba-bee9-e8a4de8f9438', 'created_at': datetime.datetime(2026, 6, 19, 2, 33, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 33, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d27f814-8c58-4aba-bee9-e8a4de8f9438/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Trying to clone 7cfdad3b-8e43-4441-b8a6-5e338e3602af from image 3d27f814-8c58-4aba-bee9-e8a4de8f9438 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d27f814-8c58-4aba-bee9-e8a4de8f9438', 'metadata': {}}]). {{(pid=93300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:33:39 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Image download 0.00 MB at 0.00 MB/s Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf5a9aa-49d6-4882-97e6-fdb6780b2b65]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:39 devstack sudo[111807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD Jun 19 04:33:39 devstack sudo[111807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:39 devstack sudo[111801]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e 1073741824" returned: 0 in 1.027s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:39 devstack sudo[111810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e Jun 19 04:33:39 devstack sudo[111810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Flow 'volume_create_manager' (c60db372-61f3-4720-a42d-345b84aaa955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a427a2e-90bf-448e-a9f6-df11ee1aafc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a427a2e-90bf-448e-a9f6-df11ee1aafc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-351099305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3dd513-d114-452a-a987-f197aed88bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa838cb610454abcb162d0ad6f53ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:40Z,use_quota=True,user_id='ace0ae93a6c84e2fb65ac305a5149a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d49979-77f3-4393-80fa-fd90643656f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d49979-77f3-4393-80fa-fd90643656f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6140b0-2fe2-4c57-9666-5813612abffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6140b0-2fe2-4c57-9666-5813612abffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e3dd513-d114-452a-a987-f197aed88bc4', 'volume_name': 'volume-2e3dd513-d114-452a-a987-f197aed88bc4', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd879508-2e62-4763-90d9-fa9c11a13e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd879508-2e62-4763-90d9-fa9c11a13e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca819fce-f84c-4788-834b-24d45b8634d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:39 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume 2e3dd513-d114-452a-a987-f197aed88bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e3dd513-d114-452a-a987-f197aed88bc4', 'volume_size': 1} Jun 19 04:33:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Flow 'volume_create_manager' (62ab4a7b-1843-4489-8312-c9caa516154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41fd88f-ab21-467c-b44d-b52d94c32670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:40 devstack sudo[111807]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD" returned: 0 in 0.886s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41fd88f-ab21-467c-b44d-b52d94c32670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1826943238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed57e2df-a42a-407e-a1f2-9199c40cd15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa838cb610454abcb162d0ad6f53ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:40Z,use_quota=True,user_id='ace0ae93a6c84e2fb65ac305a5149a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a10767-0031-461b-9f23-028b1d915449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a10767-0031-461b-9f23-028b1d915449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be04ca8f-60ae-43e9-92bf-826456a5721c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be04ca8f-60ae-43e9-92bf-826456a5721c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed57e2df-a42a-407e-a1f2-9199c40cd15a', 'volume_name': 'volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510d2d5d-9c74-4b5a-b9fc-ca8f11c750e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510d2d5d-9c74-4b5a-b9fc-ca8f11c750e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1a7a1f-7c90-4caf-98d2-792132caae09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:40 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume ed57e2df-a42a-407e-a1f2-9199c40cd15a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a', 'volume_size': 1} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:40 devstack sudo[111814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD Jun 19 04:33:40 devstack sudo[111814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:40 devstack sudo[111810]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e" returned: 0 in 0.871s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.673s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-836940206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de116d39-9b06-4f9a-91f4-ccb33855f841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de28a97e3ee247ce9b72432925b18541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:36Z,use_quota=True,user_id='e9a93142389041a5bd30e6b50ae90b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Creating volume de116d39-9b06-4f9a-91f4-ccb33855f841 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:40 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-de116d39-9b06-4f9a-91f4-ccb33855f841 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:40 devstack sudo[111817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-de116d39-9b06-4f9a-91f4-ccb33855f841 1073741824 Jun 19 04:33:40 devstack sudo[111817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088dbce9-efdf-455c-b1b5-5d2a3dc0cd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0dcd15b-aa5d-4ed5-94cf-c246671137be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:40 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Volume volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e (96c2f4bc-3dac-413f-ace6-cf2d1b5a429e): created successfully Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0dcd15b-aa5d-4ed5-94cf-c246671137be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Flow 'volume_create_manager' (8dff030f-a985-49fe-8b91-0accc00fcf6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Flow 'volume_create_manager' (082a9812-8583-4418-8b72-caca36235cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7528444-ec06-4096-9229-c83c5c3636b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7528444-ec06-4096-9229-c83c5c3636b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1480141292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e32c13-c82b-4ff4-9582-85a338d501eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa838cb610454abcb162d0ad6f53ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:41Z,use_quota=True,user_id='ace0ae93a6c84e2fb65ac305a5149a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5b8ad6-6138-4d41-b13a-5f390d3407b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5b8ad6-6138-4d41-b13a-5f390d3407b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8755175-a9e9-4104-a106-45de205524a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8755175-a9e9-4104-a106-45de205524a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98e32c13-c82b-4ff4-9582-85a338d501eb', 'volume_name': 'volume-98e32c13-c82b-4ff4-9582-85a338d501eb', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccff43b-a7fd-4f9b-9597-6dacf7558ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccff43b-a7fd-4f9b-9597-6dacf7558ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1080ad25-e84b-411b-a882-de38a43adac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:40 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume 98e32c13-c82b-4ff4-9582-85a338d501eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98e32c13-c82b-4ff4-9582-85a338d501eb', 'volume_size': 1} Jun 19 04:33:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:40 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-dd2d3559-a619-40c4-8cd6-b02faa9c777c tempest-CreateVolumesFromImageTest-219346475 None] Created volume successfully. Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Flow 'volume_create_manager' (3943fa88-73d9-4697-870d-f70f9d5d1253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a145805a-5084-405e-ba0d-efc631715f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a145805a-5084-405e-ba0d-efc631715f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-979330418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3923067-da51-4a83-b5d6-2484910aac99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa838cb610454abcb162d0ad6f53ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:41Z,use_quota=True,user_id='ace0ae93a6c84e2fb65ac305a5149a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882a444c-c70b-41ea-8cc9-4081cd6c3adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882a444c-c70b-41ea-8cc9-4081cd6c3adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed1cf63-7fd2-4ca6-992a-531abf28df86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed1cf63-7fd2-4ca6-992a-531abf28df86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3923067-da51-4a83-b5d6-2484910aac99', 'volume_name': 'volume-c3923067-da51-4a83-b5d6-2484910aac99', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ad5a2a-4e86-40b2-a67f-3cc57bc906e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ad5a2a-4e86-40b2-a67f-3cc57bc906e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b266c8-3b27-4a1d-9ac4-4643f1ef3daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:41 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume c3923067-da51-4a83-b5d6-2484910aac99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3923067-da51-4a83-b5d6-2484910aac99', 'volume_size': 1} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:41 devstack sudo[111814]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD" returned: 1 in 0.922s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Temporary image 3d27f814-8c58-4aba-bee9-e8a4de8f9438 is fetched for user d178f630fb4c4c1bbbb9eff8e338b68a. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5152c29-d28c-4c72-9867-0aae0eb0fc03]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:41 devstack sudo[111825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD Jun 19 04:33:41 devstack sudo[111825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:41 devstack sudo[111817]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Flow 'volume_create_manager' (63c1916b-a0c4-4d5f-a89e-8275c2af8afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4b3817-457a-4fc8-adb4-bcd3051d0db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-de116d39-9b06-4f9a-91f4-ccb33855f841 1073741824" returned: 0 in 1.072s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4b3817-457a-4fc8-adb4-bcd3051d0db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1753267485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135c889c-2bea-4ab9-9ac5-8033f60d470d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa838cb610454abcb162d0ad6f53ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:42Z,use_quota=True,user_id='ace0ae93a6c84e2fb65ac305a5149a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17787055-11fa-439e-9b26-eabff959d15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17787055-11fa-439e-9b26-eabff959d15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c385a692-981b-4659-bf99-966d1423dab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c385a692-981b-4659-bf99-966d1423dab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '135c889c-2bea-4ab9-9ac5-8033f60d470d', 'volume_name': 'volume-135c889c-2bea-4ab9-9ac5-8033f60d470d', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcc9a35-5db1-4efe-a919-ce30f59b7de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcc9a35-5db1-4efe-a919-ce30f59b7de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf5e1de-c1d4-4455-8fb8-83320cc56f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:41 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume 135c889c-2bea-4ab9-9ac5-8033f60d470d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-135c889c-2bea-4ab9-9ac5-8033f60d470d', 'volume_size': 1} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-de116d39-9b06-4f9a-91f4-ccb33855f841 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:41 devstack sudo[111828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-de116d39-9b06-4f9a-91f4-ccb33855f841 Jun 19 04:33:41 devstack sudo[111828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:42 devstack sudo[111825]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:42 devstack sudo[111832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD Jun 19 04:33:42 devstack sudo[111832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:42 devstack sudo[111828]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-de116d39-9b06-4f9a-91f4-ccb33855f841" returned: 0 in 0.621s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.987s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2049235019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902563d5-0bc6-4462-9765-c854501db3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de28a97e3ee247ce9b72432925b18541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:36Z,use_quota=True,user_id='e9a93142389041a5bd30e6b50ae90b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Creating volume 902563d5-0bc6-4462-9765-c854501db3a3 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:42 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-902563d5-0bc6-4462-9765-c854501db3a3 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fddbe3d7-37cf-49b9-8d07-bdfe7ee56be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de116d39-9b06-4f9a-91f4-ccb33855f841', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:42 devstack sudo[111835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-902563d5-0bc6-4462-9765-c854501db3a3 1073741824 Jun 19 04:33:42 devstack sudo[111835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2e3173-1d0a-49cb-8e5f-fd304c8e8779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:42 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Volume volume-de116d39-9b06-4f9a-91f4-ccb33855f841 (de116d39-9b06-4f9a-91f4-ccb33855f841): created successfully Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2e3173-1d0a-49cb-8e5f-fd304c8e8779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Flow 'volume_create_manager' (95dabcd5-c508-4f67-922f-15d1662f7db1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:42 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-0b0812c9-521a-4635-9592-9feb453eb172 tempest-CreateVolumesFromImageTest-219346475 None] Created volume successfully. Jun 19 04:33:42 devstack sudo[111832]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD" returned: 1 in 0.740s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:33:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:43 devstack sudo[111835]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-902563d5-0bc6-4462-9765-c854501db3a3 1073741824" returned: 0 in 0.888s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-902563d5-0bc6-4462-9765-c854501db3a3 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:43 devstack sudo[111879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-902563d5-0bc6-4462-9765-c854501db3a3 Jun 19 04:33:43 devstack sudo[111879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:44 devstack sudo[111879]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-902563d5-0bc6-4462-9765-c854501db3a3" returned: 0 in 0.641s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.988s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635385171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393a6ec1-0cae-4d14-8d1c-d40cc62fae64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de28a97e3ee247ce9b72432925b18541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:37Z,use_quota=True,user_id='e9a93142389041a5bd30e6b50ae90b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Creating volume 393a6ec1-0cae-4d14-8d1c-d40cc62fae64 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:44 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d504c9de-2c6c-44a6-8052-c35323db2f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-902563d5-0bc6-4462-9765-c854501db3a3', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:44 devstack sudo[111882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64 1073741824 Jun 19 04:33:44 devstack sudo[111882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c01fd4d-4c60-4153-b502-8548b499701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:44 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Volume volume-902563d5-0bc6-4462-9765-c854501db3a3 (902563d5-0bc6-4462-9765-c854501db3a3): created successfully Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c01fd4d-4c60-4153-b502-8548b499701c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Flow 'volume_create_manager' (5a22fc72-672f-4074-94ed-1c2d4f0526db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:44 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c9429731-8fb1-495f-b470-94ebf9c342e9 tempest-CreateVolumesFromImageTest-219346475 None] Created volume successfully. Jun 19 04:33:44 devstack sudo[111882]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64 1073741824" returned: 0 in 0.815s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:44 devstack sudo[111888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64 Jun 19 04:33:44 devstack sudo[111888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:45 devstack sudo[111888]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64" returned: 0 in 0.617s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.159s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1817643228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463d19b6-2ab8-45a6-ab25-6d52ae75eac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de28a97e3ee247ce9b72432925b18541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:37Z,use_quota=True,user_id='e9a93142389041a5bd30e6b50ae90b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Creating volume 463d19b6-2ab8-45a6-ab25-6d52ae75eac7 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:45 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:45 devstack sudo[111891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7 1073741824 Jun 19 04:33:45 devstack sudo[111891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0d70af-97d6-4346-a534-775997d18105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a6166f-3a01-46f1-867f-b97fb55a7769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:45 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Volume volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64 (393a6ec1-0cae-4d14-8d1c-d40cc62fae64): created successfully Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a6166f-3a01-46f1-867f-b97fb55a7769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:45 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Flow 'volume_create_manager' (e8ca85b8-db39-4a83-9a42-5388dfa23e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:45 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e1b5816f-5d6e-4553-b6a8-4279bdc69423 tempest-CreateVolumesFromImageTest-219346475 None] Created volume successfully. Jun 19 04:33:46 devstack sudo[111891]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7 1073741824" returned: 0 in 0.782s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:46 devstack sudo[111896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7 Jun 19 04:33:46 devstack sudo[111896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:46 devstack sudo[111896]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7" returned: 0 in 0.612s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.030s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2129697037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333821f2-4dc1-4ddf-8e95-10808b002eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768498c166364af2a306c71ef30b14b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:39Z,use_quota=True,user_id='026ce9c8a0d846d1b1177ef3a414e8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Creating volume 333821f2-4dc1-4ddf-8e95-10808b002eaf {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:46 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:46 devstack sudo[111899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf 1073741824 Jun 19 04:33:46 devstack sudo[111899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a93b27-f330-4dda-9ddd-5057f2ada7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:46 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bb64fb-f78e-4d16-ae35-20772375a493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:46 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Volume volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7 (463d19b6-2ab8-45a6-ab25-6d52ae75eac7): created successfully Jun 19 04:33:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bb64fb-f78e-4d16-ae35-20772375a493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:47 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Flow 'volume_create_manager' (ddcd64f5-de62-4063-8313-0270445a0a0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:47 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-df037f99-c56f-40dc-a8ee-412e3de83bcc tempest-CreateVolumesFromImageTest-219346475 None] Created volume successfully. Jun 19 04:33:47 devstack sudo[111899]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf 1073741824" returned: 0 in 0.789s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:47 devstack sudo[111904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf Jun 19 04:33:47 devstack sudo[111904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "cinder-463d19b6-2ab8-45a6-ab25-6d52ae75eac7-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-463d19b6-2ab8-45a6-ab25-6d52ae75eac7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "cinder-quobyte-463d19b6-2ab8-45a6-ab25-6d52ae75eac7" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-quobyte-463d19b6-2ab8-45a6-ab25-6d52ae75eac7" acquired by "delete_volume" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b0bad6-020e-4ec1-96fd-c29e3b253344]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:48 devstack sudo[111907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7 Jun 19 04:33:48 devstack sudo[111907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:48 devstack sudo[111904]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf" returned: 0 in 0.651s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.437s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-351099305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3dd513-d114-452a-a987-f197aed88bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa838cb610454abcb162d0ad6f53ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:40Z,use_quota=True,user_id='ace0ae93a6c84e2fb65ac305a5149a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Creating volume 2e3dd513-d114-452a-a987-f197aed88bc4 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:48 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2e3dd513-d114-452a-a987-f197aed88bc4 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6cbf9dd-c829-4ee3-90a1-67a824639f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-333821f2-4dc1-4ddf-8e95-10808b002eaf', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:48 devstack sudo[111910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2e3dd513-d114-452a-a987-f197aed88bc4 1073741824 Jun 19 04:33:48 devstack sudo[111910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6cd199-30c4-4199-abb8-3be3baa955f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:48 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Volume volume-333821f2-4dc1-4ddf-8e95-10808b002eaf (333821f2-4dc1-4ddf-8e95-10808b002eaf): created successfully Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6cd199-30c4-4199-abb8-3be3baa955f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:48 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Flow 'volume_create_manager' (723ee207-7912-4e50-a078-acc413dede4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:48 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-797d6f96-ec88-421a-9981-fe1f98359590 tempest-CinderUnicodeTest-281503540 None] Created volume successfully. Jun 19 04:33:49 devstack sudo[111907]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7" returned: 0 in 0.779s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:49 devstack sudo[111918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7 Jun 19 04:33:49 devstack sudo[111918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:49 devstack sudo[111910]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2e3dd513-d114-452a-a987-f197aed88bc4 1073741824" returned: 0 in 0.850s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2e3dd513-d114-452a-a987-f197aed88bc4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:49 devstack sudo[111922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2e3dd513-d114-452a-a987-f197aed88bc4 Jun 19 04:33:49 devstack sudo[111922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:49 devstack sudo[111918]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-463d19b6-2ab8-45a6-ab25-6d52ae75eac7" returned: 0 in 0.758s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-quobyte-463d19b6-2ab8-45a6-ab25-6d52ae75eac7" released by "delete_volume" :: held 1.587s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Created reservations ['6f437dfd-cbea-47b3-bb8d-90d3c0714340', 'e6d21e33-9a73-40d4-9ac2-9970663816b0', 'dc0218d1-eab7-4158-ad29-9a663a0a7cec', '30e23164-b43d-47b8-8447-6abc0cdea2e8'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:49 devstack sudo[111927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:33:49 devstack sudo[111927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:49 devstack sudo[111922]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2e3dd513-d114-452a-a987-f197aed88bc4" returned: 0 in 0.676s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.517s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1826943238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed57e2df-a42a-407e-a1f2-9199c40cd15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa838cb610454abcb162d0ad6f53ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:40Z,use_quota=True,user_id='ace0ae93a6c84e2fb65ac305a5149a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Creating volume ed57e2df-a42a-407e-a1f2-9199c40cd15a {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:49 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca819fce-f84c-4788-834b-24d45b8634d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e3dd513-d114-452a-a987-f197aed88bc4', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:50 devstack sudo[111929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a 1073741824 Jun 19 04:33:50 devstack sudo[111929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78269aa-8550-4b27-a0ac-8efbbb1ebe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:50 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume volume-2e3dd513-d114-452a-a987-f197aed88bc4 (2e3dd513-d114-452a-a987-f197aed88bc4): created successfully Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78269aa-8550-4b27-a0ac-8efbbb1ebe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Flow 'volume_create_manager' (c60db372-61f3-4720-a42d-345b84aaa955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:50 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ff96d127-04c4-454f-aae4-a5c3b81ad934 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Created volume successfully. Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "cinder-393a6ec1-0cae-4d14-8d1c-d40cc62fae64-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-393a6ec1-0cae-4d14-8d1c-d40cc62fae64-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "cinder-quobyte-393a6ec1-0cae-4d14-8d1c-d40cc62fae64" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-quobyte-393a6ec1-0cae-4d14-8d1c-d40cc62fae64" acquired by "delete_volume" :: waited 0.024s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9363391f-774a-4edd-a879-900b939c694d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:50 devstack sudo[111927]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.697s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:50 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Deleted volume successfully. Jun 19 04:33:50 devstack sudo[111932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64 Jun 19 04:33:50 devstack sudo[111932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-102873b5-0cb8-4d66-875d-ac1a7f2da73b tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-463d19b6-2ab8-45a6-ab25-6d52ae75eac7-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:50 devstack sudo[111929]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a 1073741824" returned: 0 in 0.982s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:51 devstack sudo[111938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a Jun 19 04:33:51 devstack sudo[111938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:51 devstack sudo[111932]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64" returned: 0 in 0.840s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:51 devstack sudo[111943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64 Jun 19 04:33:51 devstack sudo[111943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:51 devstack sudo[111938]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a" returned: 0 in 0.726s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.892s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1480141292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e32c13-c82b-4ff4-9582-85a338d501eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa838cb610454abcb162d0ad6f53ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:41Z,use_quota=True,user_id='ace0ae93a6c84e2fb65ac305a5149a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Creating volume 98e32c13-c82b-4ff4-9582-85a338d501eb {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:51 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-98e32c13-c82b-4ff4-9582-85a338d501eb 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:51 devstack sudo[111946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-98e32c13-c82b-4ff4-9582-85a338d501eb 1073741824 Jun 19 04:33:51 devstack sudo[111946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1a7a1f-7c90-4caf-98d2-792132caae09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c2c591-55ab-4fb3-87fc-a00df4897b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:51 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a (ed57e2df-a42a-407e-a1f2-9199c40cd15a): created successfully Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c2c591-55ab-4fb3-87fc-a00df4897b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Flow 'volume_create_manager' (62ab4a7b-1843-4489-8312-c9caa516154c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:51 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-774de182-a899-4c02-a54d-fd8beb0c2a7a tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Created volume successfully. Jun 19 04:33:52 devstack sudo[111943]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-393a6ec1-0cae-4d14-8d1c-d40cc62fae64" returned: 0 in 0.698s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-quobyte-393a6ec1-0cae-4d14-8d1c-d40cc62fae64" released by "delete_volume" :: held 1.611s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Created reservations ['78738c6f-545a-4f30-93e8-66105975226a', 'b41af94f-03bc-43db-bbc9-ee146165b203', '450fcfd7-e6d5-4c34-af99-69de41858baf', '74347f1a-c271-4821-89d2-3bc8506c037f'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:52 devstack sudo[111949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:33:52 devstack sudo[111949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "cinder-902563d5-0bc6-4462-9765-c854501db3a3-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-902563d5-0bc6-4462-9765-c854501db3a3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:52 devstack sudo[111946]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-98e32c13-c82b-4ff4-9582-85a338d501eb 1073741824" returned: 0 in 0.905s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-98e32c13-c82b-4ff4-9582-85a338d501eb {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "cinder-quobyte-902563d5-0bc6-4462-9765-c854501db3a3" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:52 devstack sudo[111954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-98e32c13-c82b-4ff4-9582-85a338d501eb Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-quobyte-902563d5-0bc6-4462-9765-c854501db3a3" acquired by "delete_volume" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:52 devstack sudo[111954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6301894f-2511-42c5-81fb-2627b4c4912e]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-902563d5-0bc6-4462-9765-c854501db3a3 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:52 devstack sudo[111949]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.673s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:52 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Deleted volume successfully. Jun 19 04:33:52 devstack sudo[111957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-902563d5-0bc6-4462-9765-c854501db3a3 Jun 19 04:33:52 devstack sudo[111957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f8e3137b-5f5b-4627-907c-ab0d13bc2694 tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-393a6ec1-0cae-4d14-8d1c-d40cc62fae64-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:53 devstack sudo[111954]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-98e32c13-c82b-4ff4-9582-85a338d501eb" returned: 0 in 0.717s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.139s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-979330418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3923067-da51-4a83-b5d6-2484910aac99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa838cb610454abcb162d0ad6f53ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:41Z,use_quota=True,user_id='ace0ae93a6c84e2fb65ac305a5149a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Creating volume c3923067-da51-4a83-b5d6-2484910aac99 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:53 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c3923067-da51-4a83-b5d6-2484910aac99 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1080ad25-e84b-411b-a882-de38a43adac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98e32c13-c82b-4ff4-9582-85a338d501eb', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:53 devstack sudo[111962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c3923067-da51-4a83-b5d6-2484910aac99 1073741824 Jun 19 04:33:53 devstack sudo[111962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34746af-6609-40fe-87e6-0086ea966ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:53 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume volume-98e32c13-c82b-4ff4-9582-85a338d501eb (98e32c13-c82b-4ff4-9582-85a338d501eb): created successfully Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34746af-6609-40fe-87e6-0086ea966ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Flow 'volume_create_manager' (082a9812-8583-4418-8b72-caca36235cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:53 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-bb6108ff-a136-42eb-8ef6-3ddba20cb11e tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Created volume successfully. Jun 19 04:33:53 devstack sudo[111957]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-902563d5-0bc6-4462-9765-c854501db3a3" returned: 0 in 0.793s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-902563d5-0bc6-4462-9765-c854501db3a3 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:53 devstack sudo[111965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-902563d5-0bc6-4462-9765-c854501db3a3 Jun 19 04:33:53 devstack sudo[111965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:54 devstack sudo[111965]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-902563d5-0bc6-4462-9765-c854501db3a3" returned: 0 in 0.657s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-quobyte-902563d5-0bc6-4462-9765-c854501db3a3" released by "delete_volume" :: held 1.507s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:54 devstack sudo[111962]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c3923067-da51-4a83-b5d6-2484910aac99 1073741824" returned: 0 in 0.826s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c3923067-da51-4a83-b5d6-2484910aac99 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Created reservations ['6c384a48-1c0f-474f-80d4-067c572421f6', 'd995b2e7-bdd0-4f97-8f1c-ea97a039f7a7', '88ca0713-6f34-4c49-b003-2a3989d0c62f', '0cd5f60a-bb90-4573-8d72-8292be432229'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:54 devstack sudo[111972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c3923067-da51-4a83-b5d6-2484910aac99 Jun 19 04:33:54 devstack sudo[111972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:54 devstack sudo[111974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:33:54 devstack sudo[111974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "cinder-de116d39-9b06-4f9a-91f4-ccb33855f841-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-de116d39-9b06-4f9a-91f4-ccb33855f841-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "cinder-quobyte-de116d39-9b06-4f9a-91f4-ccb33855f841" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-quobyte-de116d39-9b06-4f9a-91f4-ccb33855f841" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b37f05f-b441-4c96-b1ae-19b666bbba8d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-de116d39-9b06-4f9a-91f4-ccb33855f841 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:55 devstack sudo[111972]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c3923067-da51-4a83-b5d6-2484910aac99" returned: 0 in 0.750s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.285s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1753267485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135c889c-2bea-4ab9-9ac5-8033f60d470d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa838cb610454abcb162d0ad6f53ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:42Z,use_quota=True,user_id='ace0ae93a6c84e2fb65ac305a5149a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Creating volume 135c889c-2bea-4ab9-9ac5-8033f60d470d {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:55 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-135c889c-2bea-4ab9-9ac5-8033f60d470d 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:55 devstack sudo[111979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-135c889c-2bea-4ab9-9ac5-8033f60d470d 1073741824 Jun 19 04:33:55 devstack sudo[111979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b266c8-3b27-4a1d-9ac4-4643f1ef3daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3923067-da51-4a83-b5d6-2484910aac99', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:55 devstack sudo[111974]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:55 devstack sudo[111978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-de116d39-9b06-4f9a-91f4-ccb33855f841 Jun 19 04:33:55 devstack sudo[111978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5108f457-e042-4ff5-a708-a8b9480d967f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.720s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:55 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Deleted volume successfully. Jun 19 04:33:55 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume volume-c3923067-da51-4a83-b5d6-2484910aac99 (c3923067-da51-4a83-b5d6-2484910aac99): created successfully Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5108f457-e042-4ff5-a708-a8b9480d967f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Flow 'volume_create_manager' (3943fa88-73d9-4697-870d-f70f9d5d1253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8de9b9fa-b0e8-45d3-8dbe-021cf1e95a2b tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-902563d5-0bc6-4462-9765-c854501db3a3-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:55 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b1e1627f-d28c-44a6-9351-ae4a54a2ccd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Created volume successfully. Jun 19 04:33:55 devstack sudo[111978]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-de116d39-9b06-4f9a-91f4-ccb33855f841" returned: 0 in 0.868s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-de116d39-9b06-4f9a-91f4-ccb33855f841 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:55 devstack sudo[111988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-de116d39-9b06-4f9a-91f4-ccb33855f841 Jun 19 04:33:55 devstack sudo[111988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:55 devstack sudo[111979]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-135c889c-2bea-4ab9-9ac5-8033f60d470d 1073741824" returned: 0 in 0.864s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-135c889c-2bea-4ab9-9ac5-8033f60d470d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:56 devstack sudo[111990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-135c889c-2bea-4ab9-9ac5-8033f60d470d Jun 19 04:33:56 devstack sudo[111990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:56 devstack sudo[111988]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-de116d39-9b06-4f9a-91f4-ccb33855f841" returned: 0 in 0.699s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-quobyte-de116d39-9b06-4f9a-91f4-ccb33855f841" released by "delete_volume" :: held 1.632s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:56 devstack sudo[111990]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-135c889c-2bea-4ab9-9ac5-8033f60d470d" returned: 0 in 0.635s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.657s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfdad3b-8e43-4441-b8a6-5e338e3602af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d80b65088a4a84ae40db23b0d35ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:39Z,use_quota=True,user_id='d178f630fb4c4c1bbbb9eff8e338b68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3e80f49-eff9-4477-8212-0a37098b60ee),volume_type_id=d3e80f49-eff9-4477-8212-0a37098b60ee)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Creating volume 7cfdad3b-8e43-4441-b8a6-5e338e3602af {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:56 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:56 devstack sudo[111994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af 1073741824 Jun 19 04:33:56 devstack sudo[111994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf5e1de-c1d4-4455-8fb8-83320cc56f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-135c889c-2bea-4ab9-9ac5-8033f60d470d', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7318ce46-e35a-42b6-ae93-ad8cb7d4b74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:56 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Volume volume-135c889c-2bea-4ab9-9ac5-8033f60d470d (135c889c-2bea-4ab9-9ac5-8033f60d470d): created successfully Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7318ce46-e35a-42b6-ae93-ad8cb7d4b74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Flow 'volume_create_manager' (63c1916b-a0c4-4d5f-a89e-8275c2af8afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Created reservations ['4ecd941f-6dad-417f-8911-7f19c04d08a9', '1289e84a-0ff5-4b55-833c-718603f1854a', '42fd7ec3-6c89-49e2-9f6a-cfcf0ad09d1b', '6e91dc4d-872a-4f6d-baac-741f1d798313'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:56 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-66eb837c-fc42-4994-90c2-c003098a7164 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Created volume successfully. Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:56 devstack sudo[111996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:33:56 devstack sudo[111996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "cinder-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "cinder-quobyte-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-quobyte-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e" acquired by "delete_volume" :: waited 0.021s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8d04f2-1346-4c43-8588-7677b2e8883b]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:57 devstack sudo[112001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e Jun 19 04:33:57 devstack sudo[112001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:57 devstack sudo[111996]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.635s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:57 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Deleted volume successfully. Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b95992cd-9122-4390-bebb-f40e71657b90 tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-de116d39-9b06-4f9a-91f4-ccb33855f841-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:57 devstack sudo[111994]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af 1073741824" returned: 0 in 0.884s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:57 devstack sudo[112004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af Jun 19 04:33:57 devstack sudo[112004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "cinder-135c889c-2bea-4ab9-9ac5-8033f60d470d-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-135c889c-2bea-4ab9-9ac5-8033f60d470d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "cinder-quobyte-135c889c-2bea-4ab9-9ac5-8033f60d470d" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-quobyte-135c889c-2bea-4ab9-9ac5-8033f60d470d" acquired by "delete_volume" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3d64f0-0f00-437b-ad0d-2c749a8aae36]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-135c889c-2bea-4ab9-9ac5-8033f60d470d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:58 devstack sudo[112006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-135c889c-2bea-4ab9-9ac5-8033f60d470d Jun 19 04:33:58 devstack sudo[112006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:58 devstack sudo[112001]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e" returned: 0 in 0.834s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:58 devstack sudo[112011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e Jun 19 04:33:58 devstack sudo[112011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:58 devstack sudo[112004]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af" returned: 0 in 0.791s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.675s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] Creating offline snapshot b7dd3075-6c28-414b-a152-3bd0e6584d8b of volume 333821f2-4dc1-4ddf-8e95-10808b002eaf {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Attempting download of 3d27f814-8c58-4aba-bee9-e8a4de8f9438 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d27f814-8c58-4aba-bee9-e8a4de8f9438', 'metadata': {}}])) to volume 7cfdad3b-8e43-4441-b8a6-5e338e3602af. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6242332-6268-4ae9-8f79-ca9daeadf497]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[656eb7cd-6d68-4740-81f5-55db2c9001dd]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d27f814-8c58-4aba-bee9-e8a4de8f9438_0mr8id4r {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:58 devstack sudo[112014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf Jun 19 04:33:58 devstack sudo[112014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:58 devstack sudo[112015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d27f814-8c58-4aba-bee9-e8a4de8f9438_0mr8id4r Jun 19 04:33:58 devstack sudo[112015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:58 devstack sudo[112006]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-135c889c-2bea-4ab9-9ac5-8033f60d470d" returned: 0 in 0.858s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-135c889c-2bea-4ab9-9ac5-8033f60d470d {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:58 devstack sudo[112023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-135c889c-2bea-4ab9-9ac5-8033f60d470d Jun 19 04:33:58 devstack sudo[112023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:58 devstack sudo[112011]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e" returned: 0 in 0.687s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-quobyte-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e" released by "delete_volume" :: held 1.564s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:58 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Created reservations ['6efb68e4-e5f4-4541-8294-05b013a17b47', 'f5fd4f4b-63b3-440a-b06f-b466dbdd116d', '41d78bc6-535c-4a2f-814c-629b415b9104', 'be0bb51e-5b89-4e5a-8d88-1be1cebc2cc1'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:59 devstack sudo[112025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:33:59 devstack sudo[112025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:59 devstack sudo[112015]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d27f814-8c58-4aba-bee9-e8a4de8f9438_0mr8id4r" returned: 0 in 0.835s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d27f814-8c58-4aba-bee9-e8a4de8f9438_0mr8id4r {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:59 devstack sudo[112014]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf" returned: 0 in 0.998s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:59 devstack sudo[112034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b 1G Jun 19 04:33:59 devstack sudo[112034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:59 devstack sudo[112032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d27f814-8c58-4aba-bee9-e8a4de8f9438_0mr8id4r Jun 19 04:33:59 devstack sudo[112032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:59 devstack sudo[112023]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-135c889c-2bea-4ab9-9ac5-8033f60d470d" returned: 0 in 0.771s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-quobyte-135c889c-2bea-4ab9-9ac5-8033f60d470d" released by "delete_volume" :: held 1.681s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Created reservations ['b78e7fd7-9218-4e5a-8e46-47b46ba1dc06', '50e8ba3f-9f79-474a-be79-690bb2926baf', 'e95592fe-7f82-4c26-b6e5-da2ac6a9e833', '50d4cf9a-c21e-4a9e-9a0a-f4199e15833a'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:59 devstack sudo[112039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:33:59 devstack sudo[112039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:00 devstack sudo[112025]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.030s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:00 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Deleted volume successfully. Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-67bfbcf4-ca98-49a2-ba3e-7ac7577c5e30 tempest-CreateVolumesFromImageTest-219346475 None] Lock "cinder-96c2f4bc-3dac-413f-ace6-cf2d1b5a429e-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "cinder-c3923067-da51-4a83-b5d6-2484910aac99-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:00 devstack sudo[112032]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d27f814-8c58-4aba-bee9-e8a4de8f9438_0mr8id4r" returned: 1 in 0.891s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d27f814-8c58-4aba-bee9-e8a4de8f9438_0mr8id4r' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbd3227-c237-4be3-8fb3-a0175f782a6d]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-c3923067-da51-4a83-b5d6-2484910aac99-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "cinder-quobyte-c3923067-da51-4a83-b5d6-2484910aac99" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-quobyte-c3923067-da51-4a83-b5d6-2484910aac99" acquired by "delete_volume" :: waited 0.022s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[678bd521-972d-4d6c-9d1a-a3314d3883a9]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c3923067-da51-4a83-b5d6-2484910aac99 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:00 devstack sudo[112045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD Jun 19 04:34:00 devstack sudo[112045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:00 devstack sudo[112047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c3923067-da51-4a83-b5d6-2484910aac99 Jun 19 04:34:00 devstack sudo[112047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:00 devstack sudo[112034]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b 1G" returned: 0 in 1.221s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-333821f2-4dc1-4ddf-8e95-10808b002eaf -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:00 devstack sudo[112051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-333821f2-4dc1-4ddf-8e95-10808b002eaf -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b Jun 19 04:34:00 devstack sudo[112051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:00 devstack sudo[112039]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.987s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:00 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Deleted volume successfully. Jun 19 04:34:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8895189b-55ca-4807-9b19-9864908eb138 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-135c889c-2bea-4ab9-9ac5-8033f60d470d-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:01 devstack sudo[112045]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD" returned: 0 in 1.056s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:01 devstack sudo[112056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD Jun 19 04:34:01 devstack sudo[112056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:01 devstack sudo[112047]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c3923067-da51-4a83-b5d6-2484910aac99" returned: 0 in 1.217s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c3923067-da51-4a83-b5d6-2484910aac99 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:01 devstack sudo[112064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c3923067-da51-4a83-b5d6-2484910aac99 Jun 19 04:34:01 devstack sudo[112064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:01 devstack sudo[112051]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-333821f2-4dc1-4ddf-8e95-10808b002eaf -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b" returned: 0 in 1.015s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:01 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b is being set with open permissions: ugo+rw Jun 19 04:34:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:01 devstack sudo[112066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b Jun 19 04:34:01 devstack sudo[112066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:02 devstack sudo[112056]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD" returned: 1 in 0.829s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] 3d27f814-8c58-4aba-bee9-e8a4de8f9438 was raw, converting to raw {{(pid=93300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:02 devstack sudo[112071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af Jun 19 04:34:02 devstack sudo[112071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:02 devstack sudo[112064]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c3923067-da51-4a83-b5d6-2484910aac99" returned: 0 in 0.720s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-quobyte-c3923067-da51-4a83-b5d6-2484910aac99" released by "delete_volume" :: held 1.996s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Created reservations ['a150b575-b2fb-4ae8-baa3-bdd06814675b', '9936d5c9-c595-4506-8f43-a7c9a155c434', '82ab099b-1ac5-4a2a-b164-a82442a268fa', 'dcf05f20-0a2c-45bc-b945-bb8e8bb62213'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:02 devstack sudo[112066]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b" returned: 0 in 0.850s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:02 devstack sudo[112075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:02 devstack sudo[112075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "cinder-98e32c13-c82b-4ff4-9582-85a338d501eb-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:02 devstack sudo[112077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.info Jun 19 04:34:02 devstack sudo[112077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-98e32c13-c82b-4ff4-9582-85a338d501eb-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "cinder-quobyte-98e32c13-c82b-4ff4-9582-85a338d501eb" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-quobyte-98e32c13-c82b-4ff4-9582-85a338d501eb" acquired by "delete_volume" :: waited 0.024s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fed1a59-cbf0-4545-b8f1-4212f8246768]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-98e32c13-c82b-4ff4-9582-85a338d501eb {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:02 devstack sudo[112079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-98e32c13-c82b-4ff4-9582-85a338d501eb Jun 19 04:34:02 devstack sudo[112079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:03 devstack sudo[112071]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af" returned: 0 in 1.130s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:03 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d27f814-8c58-4aba-bee9-e8a4de8f9438_worc6r2pdevstack@QuobyteHD, size 0.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:34:03 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Converted 0.00 MB image at 0.00 MB/s Jun 19 04:34:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:03 devstack sudo[112085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af 1G Jun 19 04:34:03 devstack sudo[112085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:03 devstack sudo[112075]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.880s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:03 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:03 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Deleted volume successfully. Jun 19 04:34:03 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-b99f14ee-8676-434e-a5ba-45b267406b51 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-c3923067-da51-4a83-b5d6-2484910aac99-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:03 devstack sudo[112077]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.info" returned: 0 in 0.999s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:03 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.info is being set with open permissions: ugo+rw Jun 19 04:34:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:03 devstack sudo[112088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.info Jun 19 04:34:03 devstack sudo[112088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:03 devstack sudo[112079]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-98e32c13-c82b-4ff4-9582-85a338d501eb" returned: 0 in 1.041s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:03 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-98e32c13-c82b-4ff4-9582-85a338d501eb {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:03 devstack sudo[112093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-98e32c13-c82b-4ff4-9582-85a338d501eb Jun 19 04:34:03 devstack sudo[112093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:04 devstack sudo[112085]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af 1G" returned: 0 in 0.855s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c596f82-61d3-464a-9414-846e7d49b905]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:04 devstack sudo[112098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af Jun 19 04:34:04 devstack sudo[112098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:04 devstack sudo[112088]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.info" returned: 0 in 0.868s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.116s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:04 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e4a98247-0c7f-4d60-8aed-b1afb021e2b3 tempest-CinderUnicodeTest-281503540 None] Create snapshot completed successfully Jun 19 04:34:04 devstack sudo[112093]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-98e32c13-c82b-4ff4-9582-85a338d501eb" returned: 0 in 0.804s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-quobyte-98e32c13-c82b-4ff4-9582-85a338d501eb" released by "delete_volume" :: held 1.906s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Created reservations ['1171184a-ac4f-4db5-88c7-ccd908818451', '38c3da7d-6085-4043-8032-b1508bd1e676', '8c28196c-6980-43fe-81da-259400ab1274', '36cb52fe-30e9-4daa-ab60-3bf37daed229'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:04 devstack sudo[112102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:04 devstack sudo[112102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "cinder-ed57e2df-a42a-407e-a1f2-9199c40cd15a-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-ed57e2df-a42a-407e-a1f2-9199c40cd15a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "cinder-quobyte-ed57e2df-a42a-407e-a1f2-9199c40cd15a" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:04 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-quobyte-ed57e2df-a42a-407e-a1f2-9199c40cd15a" acquired by "delete_volume" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[073a24cb-4e12-460b-96cc-959dcdf552b3]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:05 devstack sudo[112098]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af" returned: 0 in 0.943s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:05 devstack sudo[112106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a Jun 19 04:34:05 devstack sudo[112106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:05 devstack sudo[112107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af Jun 19 04:34:05 devstack sudo[112107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:05 devstack sudo[112102]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.803s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Acquiring lock "cinder-b7dd3075-6c28-414b-a152-3bd0e6584d8b-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:05 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Deleted volume successfully. Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-05b3c774-7c71-4ee3-b27a-75d9550a8802 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-98e32c13-c82b-4ff4-9582-85a338d501eb-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Lock "cinder-b7dd3075-6c28-414b-a152-3bd0e6584d8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Acquiring lock "cinder-quobyte-333821f2-4dc1-4ddf-8e95-10808b002eaf" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Lock "cinder-quobyte-333821f2-4dc1-4ddf-8e95-10808b002eaf" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Acquiring lock "cinder-quobyte-b7dd3075-6c28-414b-a152-3bd0e6584d8b" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Lock "cinder-quobyte-b7dd3075-6c28-414b-a152-3bd0e6584d8b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Deleting offline snapshot b7dd3075-6c28-414b-a152-3bd0e6584d8b of volume 333821f2-4dc1-4ddf-8e95-10808b002eaf {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] snapshot_file for this snap is: volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c26696b-eee6-4b75-af66-68418449e774]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:05 devstack sudo[112111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b Jun 19 04:34:05 devstack sudo[112111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:05 devstack sudo[112106]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a" returned: 0 in 0.943s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:06 devstack sudo[112120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a Jun 19 04:34:06 devstack sudo[112120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:06 devstack sudo[112107]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af" returned: 1 in 1.056s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Downloaded image 3d27f814-8c58-4aba-bee9-e8a4de8f9438 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d27f814-8c58-4aba-bee9-e8a4de8f9438', 'metadata': {}}])) to volume 7cfdad3b-8e43-4441-b8a6-5e338e3602af successfully. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Temporary image 3d27f814-8c58-4aba-bee9-e8a4de8f9438 for user d178f630fb4c4c1bbbb9eff8e338b68a is deleted. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Marking volume 7cfdad3b-8e43-4441-b8a6-5e338e3602af as bootable. {{(pid=93300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Copying metadata from image 3d27f814-8c58-4aba-bee9-e8a4de8f9438 to 7cfdad3b-8e43-4441-b8a6-5e338e3602af. {{(pid=93300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Creating volume glance metadata for volume 7cfdad3b-8e43-4441-b8a6-5e338e3602af backed by image 3d27f814-8c58-4aba-bee9-e8a4de8f9438 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3d27f814-8c58-4aba-bee9-e8a4de8f9438', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '17c18ad446f6a1967e598179abffa401', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a326f6f-d1ab-4607-ba17-3bd0d6b63dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af', 'volume_size': 1, 'image_id': '3d27f814-8c58-4aba-bee9-e8a4de8f9438', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d27f814-8c58-4aba-bee9-e8a4de8f9438', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '17c18ad446f6a1967e598179abffa401', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '94d80b65088a4a84ae40db23b0d35ff2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34d6928bd1daf02ea9f0ab4aa0143c9cdfc5b2706fd649b012ef3d76d1dbd6b694b271b0213b3c86081e069817a42df0e7000e250e603b24ce2837be58f2cd17', 'id': '3d27f814-8c58-4aba-bee9-e8a4de8f9438', 'created_at': datetime.datetime(2026, 6, 19, 2, 33, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 33, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d27f814-8c58-4aba-bee9-e8a4de8f9438/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383fd3d4-a680-401d-a044-96c7ec5659e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:06 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Volume volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af (7cfdad3b-8e43-4441-b8a6-5e338e3602af): created successfully Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383fd3d4-a680-401d-a044-96c7ec5659e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Flow 'volume_create_manager' (1759a65c-8623-48d7-a61b-2153fff2fce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:06 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-026e8371-033a-4da4-8513-0a37e1bbc7d5 tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Created volume successfully. Jun 19 04:34:06 devstack sudo[112111]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:06 devstack sudo[112120]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b" returned: 0 in 0.947s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-333821f2-4dc1-4ddf-8e95-10808b002eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed57e2df-a42a-407e-a1f2-9199c40cd15a" returned: 0 in 0.739s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[26102607-6964-4d59-849f-521f394369bf]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-quobyte-ed57e2df-a42a-407e-a1f2-9199c40cd15a" released by "delete_volume" :: held 1.750s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Flow 'volume_create_manager' (9b2eff83-772d-4736-947d-788c860b4afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d79c1d-86e7-4d2c-89de-d7ed34557a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d79c1d-86e7-4d2c-89de-d7ed34557a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5ad442-043f-46a9-a4fe-d3bacbd1e829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5966797b634e61b740b36c12286882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:07Z,use_quota=True,user_id='6bab5412e5b24dd390a680c909d241cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b3340a-77d1-4e4f-a183-7666286553c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b3340a-77d1-4e4f-a183-7666286553c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (753d3ae0-2188-412e-a678-2eb8d2121c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.image.glance [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Creating Keystone auth plugin from conf {{(pid=93300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:34:06 devstack sudo[112126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf Jun 19 04:34:06 devstack sudo[112126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Created reservations ['b62b6926-114c-4405-9f5c-65e556cb6e69', 'e2e98a66-b842-460e-a077-c2ae81113656', '8529a065-a3f8-4cc3-898c-ba7200cda839', 'd282692e-5c9a-4fd8-8d83-f02f552bbbad'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:06 devstack sudo[112128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:06 devstack sudo[112128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (753d3ae0-2188-412e-a678-2eb8d2121c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b5ad442-043f-46a9-a4fe-d3bacbd1e829', 'volume_name': 'volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829', 'volume_size': 1, 'image_id': '9eb675b7-e39f-4015-9d72-38258507bb96', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb675b7-e39f-4015-9d72-38258507bb96', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c13b8ae29c6a8a444201dad8e233b936', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be5966797b634e61b740b36c12286882', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '764a004d56a153a108e3903cd0a03c50c11073939cff552fc629365e3c626e4af5932a46afda4c3a34919533d597e055c82e65ca04d8c15ef05921dd6849568e', 'id': '9eb675b7-e39f-4015-9d72-38258507bb96', 'created_at': datetime.datetime(2026, 6, 19, 2, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 34, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb675b7-e39f-4015-9d72-38258507bb96/file', 'properties': {}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7959dff-902e-4fcb-ac6a-df7e5c12c77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7959dff-902e-4fcb-ac6a-df7e5c12c77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff5442c-db5c-4c03-9b7e-3055fad3e3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:07 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Volume 0b5ad442-043f-46a9-a4fe-d3bacbd1e829: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829', 'volume_size': 1, 'image_id': '9eb675b7-e39f-4015-9d72-38258507bb96', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb675b7-e39f-4015-9d72-38258507bb96', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c13b8ae29c6a8a444201dad8e233b936', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be5966797b634e61b740b36c12286882', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '764a004d56a153a108e3903cd0a03c50c11073939cff552fc629365e3c626e4af5932a46afda4c3a34919533d597e055c82e65ca04d8c15ef05921dd6849568e', 'id': '9eb675b7-e39f-4015-9d72-38258507bb96', 'created_at': datetime.datetime(2026, 6, 19, 2, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 34, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb675b7-e39f-4015-9d72-38258507bb96/file', 'properties': {}}, 'image_service': } Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Trying to clone 0b5ad442-043f-46a9-a4fe-d3bacbd1e829 from image 9eb675b7-e39f-4015-9d72-38258507bb96 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9eb675b7-e39f-4015-9d72-38258507bb96', 'metadata': {}}]). {{(pid=93300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Acquiring lock "cinder-7cfdad3b-8e43-4441-b8a6-5e338e3602af-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Lock "cinder-7cfdad3b-8e43-4441-b8a6-5e338e3602af-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "cinder-2e3dd513-d114-452a-a987-f197aed88bc4-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Acquiring lock "cinder-quobyte-7cfdad3b-8e43-4441-b8a6-5e338e3602af" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-2e3dd513-d114-452a-a987-f197aed88bc4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Lock "cinder-quobyte-7cfdad3b-8e43-4441-b8a6-5e338e3602af" acquired by "delete_volume" :: waited 0.033s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:34:07 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Image download 0.00 MB at 0.00 MB/s Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "cinder-quobyte-2e3dd513-d114-452a-a987-f197aed88bc4" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-quobyte-2e3dd513-d114-452a-a987-f197aed88bc4" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22ce0f5-c333-484d-a054-c064d609aaf7]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[69674664-434a-4995-8299-8386d17be754]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2e3dd513-d114-452a-a987-f197aed88bc4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c06704-97d5-4aa8-8abe-5a2fd0808017]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:07 devstack sudo[112130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af Jun 19 04:34:07 devstack sudo[112130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:07 devstack sudo[112131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2e3dd513-d114-452a-a987-f197aed88bc4 Jun 19 04:34:07 devstack sudo[112131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:07 devstack sudo[112132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD Jun 19 04:34:07 devstack sudo[112132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:07 devstack sudo[112126]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf" returned: 0 in 1.036s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:07 devstack sudo[112140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b Jun 19 04:34:07 devstack sudo[112140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:07 devstack sudo[112128]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.943s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:07 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Deleted volume successfully. Jun 19 04:34:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ed62180f-cb7b-44b3-a814-b31dbc84475d tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-ed57e2df-a42a-407e-a1f2-9199c40cd15a-delete_volume" released by "delete_volume" :: held 2.999s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:08 devstack sudo[112131]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2e3dd513-d114-452a-a987-f197aed88bc4" returned: 0 in 0.886s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2e3dd513-d114-452a-a987-f197aed88bc4 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:08 devstack sudo[112149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2e3dd513-d114-452a-a987-f197aed88bc4 Jun 19 04:34:08 devstack sudo[112149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:08 devstack sudo[112130]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af" returned: 0 in 0.979s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:08 devstack sudo[112132]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD" returned: 0 in 1.013s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:08 devstack sudo[112153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af Jun 19 04:34:08 devstack sudo[112153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:08 devstack sudo[112155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD Jun 19 04:34:08 devstack sudo[112155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:08 devstack sudo[112140]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b" returned: 0 in 0.858s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:08 devstack sudo[112158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b Jun 19 04:34:08 devstack sudo[112158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:09 devstack sudo[112149]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2e3dd513-d114-452a-a987-f197aed88bc4" returned: 0 in 0.705s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-quobyte-2e3dd513-d114-452a-a987-f197aed88bc4" released by "delete_volume" :: held 1.652s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Created reservations ['62ec2133-8e01-462c-87e7-59dae2921092', '261b09e5-dbbf-4517-8d05-690b9bd79e91', '76287fda-dee9-4a70-8f51-e2203b330494', '3e775fb3-6ea9-4714-95e4-c27b606a4dd5'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:09 devstack sudo[112164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:09 devstack sudo[112164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:09 devstack sudo[112153]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af" returned: 1 in 0.851s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:09 devstack sudo[112170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af Jun 19 04:34:09 devstack sudo[112170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:09 devstack sudo[112158]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf.b7dd3075-6c28-414b-a152-3bd0e6584d8b" returned: 0 in 0.720s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:09 devstack sudo[112155]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD" returned: 1 in 0.911s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Temporary image 9eb675b7-e39f-4015-9d72-38258507bb96 is fetched for user 6bab5412e5b24dd390a680c909d241cb. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Lock "cinder-quobyte-b7dd3075-6c28-414b-a152-3bd0e6584d8b" released by "_delete_snapshot" :: held 3.715s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Lock "cinder-quobyte-333821f2-4dc1-4ddf-8e95-10808b002eaf" released by "delete_snapshot" :: held 3.759s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Created reservations ['58e33920-1e8e-4326-8914-4b5ab3644e57', 'c5377010-1ece-46b6-a42a-57a03daca59e', '5b172c9c-9e7d-42ef-846b-b5a81fcdfbc6', 'ff813cff-d9d8-4bcd-92fd-0ac102c3e24d'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[91364e41-9ec9-42fb-a42a-b870f2866563]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "cinder-c7b5b5f8-188b-483f-aa3f-935c26d27c13-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-c7b5b5f8-188b-483f-aa3f-935c26d27c13-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:09 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Delete snapshot completed successfully. Jun 19 04:34:09 devstack sudo[112172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD Jun 19 04:34:09 devstack sudo[112172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-5a43d41b-b31d-4e02-8d23-f1128f78dca9 tempest-CinderUnicodeTest-281503540 None] Lock "cinder-b7dd3075-6c28-414b-a152-3bd0e6584d8b-delete_snapshot" released by "delete_snapshot" :: held 4.061s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "cinder-quobyte-c7b5b5f8-188b-483f-aa3f-935c26d27c13" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-quobyte-c7b5b5f8-188b-483f-aa3f-935c26d27c13" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e16506-e6ea-406e-a8dd-5bc8a4b9395a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:09 devstack sudo[112175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13 Jun 19 04:34:09 devstack sudo[112175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:09 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Acquiring lock "cinder-333821f2-4dc1-4ddf-8e95-10808b002eaf-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Lock "cinder-333821f2-4dc1-4ddf-8e95-10808b002eaf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:10 devstack sudo[112164]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.903s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Acquiring lock "cinder-quobyte-333821f2-4dc1-4ddf-8e95-10808b002eaf" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:10 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Deleted volume successfully. Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Lock "cinder-quobyte-333821f2-4dc1-4ddf-8e95-10808b002eaf" acquired by "delete_volume" :: waited 0.036s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:10 devstack sudo[112170]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-7cfdad3b-8e43-4441-b8a6-5e338e3602af" returned: 0 in 0.924s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-eedeeb6a-6a14-417f-aa6b-e169d1ddfcd6 tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-2e3dd513-d114-452a-a987-f197aed88bc4-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[576c1568-6d40-4a38-bebc-2d68b0a36e02]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Lock "cinder-quobyte-7cfdad3b-8e43-4441-b8a6-5e338e3602af" released by "delete_volume" :: held 2.902s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Created reservations ['c14961db-53cd-4ff2-acb2-89e71454a9b4', 'e35736b2-0385-476f-9142-8a0eac9eaedb', '417fc99b-dc09-4e76-9b45-1f0f05b0824c', '4e00062b-ba79-49db-85ab-b73f80adb14a'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:10 devstack sudo[112179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf Jun 19 04:34:10 devstack sudo[112179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:10 devstack sudo[112183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:10 devstack sudo[112183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:10 devstack sudo[112172]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD" returned: 0 in 0.903s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:10 devstack sudo[112185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD Jun 19 04:34:10 devstack sudo[112185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:10 devstack sudo[112175]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13" returned: 0 in 1.227s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:11 devstack sudo[112192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13 Jun 19 04:34:11 devstack sudo[112192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:11 devstack sudo[112183]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.977s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:11 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Deleted volume successfully. Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f2222437-2796-4d35-bc57-38402b9e668d tempest-VolumeAndVolumeTypeFromImageTest-1498445485 None] Lock "cinder-7cfdad3b-8e43-4441-b8a6-5e338e3602af-delete_volume" released by "delete_volume" :: held 4.192s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:11 devstack sudo[112179]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf" returned: 0 in 1.240s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:11 devstack sudo[112201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf Jun 19 04:34:11 devstack sudo[112201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:11 devstack sudo[112185]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD" returned: 1 in 1.052s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5ad442-043f-46a9-a4fe-d3bacbd1e829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5966797b634e61b740b36c12286882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:07Z,use_quota=True,user_id='6bab5412e5b24dd390a680c909d241cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Creating volume 0b5ad442-043f-46a9-a4fe-d3bacbd1e829 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:11 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:11 devstack sudo[112203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 1073741824 Jun 19 04:34:11 devstack sudo[112203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:11 devstack sudo[112192]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c7b5b5f8-188b-483f-aa3f-935c26d27c13" returned: 0 in 0.891s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-quobyte-c7b5b5f8-188b-483f-aa3f-935c26d27c13" released by "delete_volume" :: held 2.181s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:11 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Created reservations ['5f7beb91-98a0-4350-b421-aed7738d4e29', '9aa231a6-ad4a-4e39-8712-a368e437ed0a', '53166636-6785-4b9f-aa31-746f6505557b', '5339cb51-25cc-4688-b401-e9709f1c1198'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:12 devstack sudo[112206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:12 devstack sudo[112206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:12 devstack sudo[112201]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-333821f2-4dc1-4ddf-8e95-10808b002eaf" returned: 0 in 0.855s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Lock "cinder-quobyte-333821f2-4dc1-4ddf-8e95-10808b002eaf" released by "delete_volume" :: held 2.181s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Created reservations ['39eb75fc-d3ef-4a2b-a170-eecdbba5b3b4', 'cfd58df8-6128-41f2-9ca2-bfa5fdc0d9cd', 'd5d58636-3cff-4bb1-8d06-95d28991b5f9', 'eb45eb8f-b51f-4751-9194-5214c4987e04'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:12 devstack sudo[112213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:12 devstack sudo[112213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:12 devstack sudo[112203]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 1073741824" returned: 0 in 1.171s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:12 devstack sudo[112215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 Jun 19 04:34:12 devstack sudo[112215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:13 devstack sudo[112206]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.940s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:13 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Deleted volume successfully. Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-249b7d63-9ec3-4fd0-b55b-44f0fc56268b tempest-CreateVolumesFromSourceVolumeTest-1354519574 None] Lock "cinder-c7b5b5f8-188b-483f-aa3f-935c26d27c13-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:13 devstack sudo[112213]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.807s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:13 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Deleted volume successfully. Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c9120f47-0720-4191-acf2-5832940dd82a tempest-CinderUnicodeTest-281503540 None] Lock "cinder-333821f2-4dc1-4ddf-8e95-10808b002eaf-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Acquiring lock "cinder-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Lock "cinder-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Acquiring lock "cinder-quobyte-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Lock "cinder-quobyte-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223" acquired by "delete_volume" :: waited 0.028s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3d7d2a-7ae0-4b9d-a75e-2269cff13f43]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:13 devstack sudo[112215]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829" returned: 0 in 0.958s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.187s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:13 devstack sudo[112220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223 Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Attempting download of 9eb675b7-e39f-4015-9d72-38258507bb96 ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb675b7-e39f-4015-9d72-38258507bb96', 'metadata': {}}])) to volume 0b5ad442-043f-46a9-a4fe-d3bacbd1e829. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:34:13 devstack sudo[112220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e03a5a7-3fe1-4d39-b644-ffa54facf8d9]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb675b7-e39f-4015-9d72-38258507bb96_m_ubj3k1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:13 devstack sudo[112222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb675b7-e39f-4015-9d72-38258507bb96_m_ubj3k1 Jun 19 04:34:13 devstack sudo[112222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:14 devstack sudo[112220]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223" returned: 0 in 1.051s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:14 devstack sudo[112229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223 Jun 19 04:34:14 devstack sudo[112229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:14 devstack sudo[112222]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb675b7-e39f-4015-9d72-38258507bb96_m_ubj3k1" returned: 0 in 1.072s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb675b7-e39f-4015-9d72-38258507bb96_m_ubj3k1 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:14 devstack sudo[112233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb675b7-e39f-4015-9d72-38258507bb96_m_ubj3k1 Jun 19 04:34:14 devstack sudo[112233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:15 devstack sudo[112229]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223" returned: 0 in 0.777s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Lock "cinder-quobyte-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223" released by "delete_volume" :: held 1.884s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:15 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Created reservations ['3107df8b-1a4d-418c-afb5-32043556f6f2', 'a1adbff3-1788-442a-bc1e-fff344f823da', 'ce932540-a6a5-43e5-887b-0092a9ade522', '6c698c18-2d98-4c69-8e6f-ecdc0c6a46fc'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:15 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:15 devstack sudo[112236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:15 devstack sudo[112236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:15 devstack sudo[112233]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb675b7-e39f-4015-9d72-38258507bb96_m_ubj3k1" returned: 1 in 0.932s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb675b7-e39f-4015-9d72-38258507bb96_m_ubj3k1' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:15 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[08486ec5-a4bc-460c-bbd5-662fb29e0e5a]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:15 devstack sudo[112240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD Jun 19 04:34:15 devstack sudo[112240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:16 devstack sudo[112236]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.716s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:16 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:16 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Deleted volume successfully. Jun 19 04:34:16 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-1c0160e1-4f1e-4984-957a-8d96752ad403 tempest-CinderUnicodeTest-281503540 None] Lock "cinder-ed58a39f-5da3-46ec-8f1b-2dc23fdd0223-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:16 devstack sudo[112240]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD" returned: 0 in 0.884s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:16 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:16 devstack sudo[112247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD Jun 19 04:34:16 devstack sudo[112247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Flow 'volume_create_manager' (aaede93e-31ac-4d08-888f-ffa9cf9307c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c9b874-a93d-4dea-8c78-2fed851fbaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c9b874-a93d-4dea-8c78-2fed851fbaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253312616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61880794-7e37-4b37-913e-24c1dce186ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a00c0fc994a828628f9e0138a1227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:17Z,use_quota=True,user_id='4fba3d0d66494343ac35b01ebf7fcea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d35f295-d812-49eb-be19-f984130a38e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d35f295-d812-49eb-be19-f984130a38e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b187adf0-37b3-4829-b342-a9ab5d00f8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b187adf0-37b3-4829-b342-a9ab5d00f8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61880794-7e37-4b37-913e-24c1dce186ef', 'volume_name': 'volume-61880794-7e37-4b37-913e-24c1dce186ef', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c685ee61-8399-40f8-bccc-cef9c6fd8479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c685ee61-8399-40f8-bccc-cef9c6fd8479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21383bfa-b588-4b2d-ab9b-6dff470902a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:17 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume 61880794-7e37-4b37-913e-24c1dce186ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61880794-7e37-4b37-913e-24c1dce186ef', 'volume_size': 1} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253312616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61880794-7e37-4b37-913e-24c1dce186ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a00c0fc994a828628f9e0138a1227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:17Z,use_quota=True,user_id='4fba3d0d66494343ac35b01ebf7fcea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Creating volume 61880794-7e37-4b37-913e-24c1dce186ef {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:17 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:17 devstack sudo[112249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef 1073741824 Jun 19 04:34:17 devstack sudo[112249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Flow 'volume_create_manager' (344d73cf-5115-40c8-863f-ab74562b74dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929b2a73-cd2c-4ed4-9ec6-66c7577e0f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929b2a73-cd2c-4ed4-9ec6-66c7577e0f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1453697019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41dc90f-6f2e-4b49-887b-7ab23c8442e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15bf5e117bf4976a6fa5bc4d8dfb8a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:18Z,use_quota=True,user_id='8e64c3d1d2f14d04ae0c7485eb2e81bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a243a52a-5fc6-4e2b-97b4-d014f6cdf483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a243a52a-5fc6-4e2b-97b4-d014f6cdf483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc61271-16a8-4b69-9391-e28372dee0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:17 devstack sudo[112247]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc61271-16a8-4b69-9391-e28372dee0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41dc90f-6f2e-4b49-887b-7ab23c8442e5', 'volume_name': 'volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6a2638-e6b3-4e02-ba70-486549c821d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6a2638-e6b3-4e02-ba70-486549c821d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77945acc-8b58-48f1-9216-2131d6d019b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:17 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Volume e41dc90f-6f2e-4b49-887b-7ab23c8442e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5', 'volume_size': 1} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD" returned: 1 in 1.153s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] 9eb675b7-e39f-4015-9d72-38258507bb96 was raw, converting to raw {{(pid=93300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:34:17 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:17 devstack sudo[112254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 Jun 19 04:34:17 devstack sudo[112254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:18 devstack sudo[112249]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef 1073741824" returned: 0 in 1.106s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:18 devstack sudo[112260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef Jun 19 04:34:18 devstack sudo[112260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:18 devstack sudo[112254]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829" returned: 0 in 0.826s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:18 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9eb675b7-e39f-4015-9d72-38258507bb96_ezwpyka9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:34:18 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Converted 0.00 MB image at 0.00 MB/s Jun 19 04:34:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:18 devstack sudo[112265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 1G Jun 19 04:34:18 devstack sudo[112265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:18 devstack sudo[112260]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef" returned: 0 in 0.720s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:18 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:18 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.165s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1453697019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41dc90f-6f2e-4b49-887b-7ab23c8442e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15bf5e117bf4976a6fa5bc4d8dfb8a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:18Z,use_quota=True,user_id='8e64c3d1d2f14d04ae0c7485eb2e81bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Creating volume e41dc90f-6f2e-4b49-887b-7ab23c8442e5 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:19 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21383bfa-b588-4b2d-ab9b-6dff470902a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61880794-7e37-4b37-913e-24c1dce186ef', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:19 devstack sudo[112268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 1073741824 Jun 19 04:34:19 devstack sudo[112268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca21495b-4cfa-490d-abda-e2f8dccb9a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:19 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume volume-61880794-7e37-4b37-913e-24c1dce186ef (61880794-7e37-4b37-913e-24c1dce186ef): created successfully Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca21495b-4cfa-490d-abda-e2f8dccb9a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Flow 'volume_create_manager' (aaede93e-31ac-4d08-888f-ffa9cf9307c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:19 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c32c69e2-2750-4a90-b10c-681a7e6b9321 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Created volume successfully. Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 29 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:34:19 devstack sudo[112265]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 1G" returned: 0 in 0.784s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7505007-ed54-4721-aedf-94f9c141a5ab]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:19 devstack sudo[112273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 Jun 19 04:34:19 devstack sudo[112273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:19 devstack sudo[112268]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 1073741824" returned: 0 in 0.986s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:20 devstack sudo[112280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 Jun 19 04:34:20 devstack sudo[112280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:20 devstack sudo[112273]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829" returned: 0 in 1.060s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:20 devstack sudo[112284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 Jun 19 04:34:20 devstack sudo[112284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:20 devstack sudo[112280]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5" returned: 0 in 0.795s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.391s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77945acc-8b58-48f1-9216-2131d6d019b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857b5568-a709-448a-93ef-010d60945ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Creating offline snapshot d33d040e-5d6e-4df5-9221-11c1485afae0 of volume 61880794-7e37-4b37-913e-24c1dce186ef {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:34:20 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Volume volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 (e41dc90f-6f2e-4b49-887b-7ab23c8442e5): created successfully Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857b5568-a709-448a-93ef-010d60945ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Flow 'volume_create_manager' (344d73cf-5115-40c8-863f-ab74562b74dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad0b7aa-5cfc-41fc-b9cb-87612ef21cf6]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:20 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:20 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ed4d894b-ca3a-4e31-ab14-faaa1b7bbc05 tempest-VolumeDependencyTests-993024082 None] Created volume successfully. Jun 19 04:34:21 devstack sudo[112287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef Jun 19 04:34:21 devstack sudo[112287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:21 devstack sudo[112284]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829" returned: 1 in 0.861s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:21 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Downloaded image 9eb675b7-e39f-4015-9d72-38258507bb96 ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb675b7-e39f-4015-9d72-38258507bb96', 'metadata': {}}])) to volume 0b5ad442-043f-46a9-a4fe-d3bacbd1e829 successfully. {{(pid=93300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:34:21 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Temporary image 9eb675b7-e39f-4015-9d72-38258507bb96 for user 6bab5412e5b24dd390a680c909d241cb is deleted. {{(pid=93300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:34:21 devstack cinder-volume[93300]: DEBUG cinder.volume.volume_utils [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Marking volume 0b5ad442-043f-46a9-a4fe-d3bacbd1e829 as bootable. {{(pid=93300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:34:21 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Copying metadata from image 9eb675b7-e39f-4015-9d72-38258507bb96 to 0b5ad442-043f-46a9-a4fe-d3bacbd1e829. {{(pid=93300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:34:21 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Creating volume glance metadata for volume 0b5ad442-043f-46a9-a4fe-d3bacbd1e829 backed by image 9eb675b7-e39f-4015-9d72-38258507bb96 with: {'image_id': '9eb675b7-e39f-4015-9d72-38258507bb96', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c13b8ae29c6a8a444201dad8e233b936', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:34:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff5442c-db5c-4c03-9b7e-3055fad3e3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829', 'volume_size': 1, 'image_id': '9eb675b7-e39f-4015-9d72-38258507bb96', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb675b7-e39f-4015-9d72-38258507bb96', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c13b8ae29c6a8a444201dad8e233b936', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be5966797b634e61b740b36c12286882', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '764a004d56a153a108e3903cd0a03c50c11073939cff552fc629365e3c626e4af5932a46afda4c3a34919533d597e055c82e65ca04d8c15ef05921dd6849568e', 'id': '9eb675b7-e39f-4015-9d72-38258507bb96', 'created_at': datetime.datetime(2026, 6, 19, 2, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 34, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb675b7-e39f-4015-9d72-38258507bb96/file', 'properties': {}}, 'image_service': }' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c423ecc7-e9c6-4831-bd92-49911ca86f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:21 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Volume volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 (0b5ad442-043f-46a9-a4fe-d3bacbd1e829): created successfully Jun 19 04:34:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c423ecc7-e9c6-4831-bd92-49911ca86f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:21 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Flow 'volume_create_manager' (9b2eff83-772d-4736-947d-788c860b4afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:21 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-3a804cf9-d0a9-4c69-8c25-96a21a284fbf tempest-VolumeImageDependencyTests-596756591 None] Created volume successfully. Jun 19 04:34:21 devstack sudo[112287]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef" returned: 0 in 0.861s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:21 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:21 devstack sudo[112295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 1G Jun 19 04:34:21 devstack sudo[112295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Acquiring lock "cinder-0b5ad442-043f-46a9-a4fe-d3bacbd1e829-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Lock "cinder-0b5ad442-043f-46a9-a4fe-d3bacbd1e829-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Acquiring lock "cinder-quobyte-0b5ad442-043f-46a9-a4fe-d3bacbd1e829" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:22 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Lock "cinder-quobyte-0b5ad442-043f-46a9-a4fe-d3bacbd1e829" acquired by "delete_volume" :: waited 0.026s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:22 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a432a7-46be-4225-a19a-b34b42bb7d1c]: (4, 'raw') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:22 devstack sudo[112297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 Jun 19 04:34:22 devstack sudo[112297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:22 devstack sudo[112295]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 1G" returned: 0 in 0.966s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:22 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61880794-7e37-4b37-913e-24c1dce186ef -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:22 devstack sudo[112303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61880794-7e37-4b37-913e-24c1dce186ef -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 Jun 19 04:34:22 devstack sudo[112303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:23 devstack sudo[112297]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829" returned: 0 in 0.850s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:23 devstack sudo[112307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 Jun 19 04:34:23 devstack sudo[112307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:23 devstack sudo[112303]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61880794-7e37-4b37-913e-24c1dce186ef -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0" returned: 0 in 0.766s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:23 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 is being set with open permissions: ugo+rw Jun 19 04:34:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:23 devstack sudo[112313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 Jun 19 04:34:23 devstack sudo[112313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:23 devstack sudo[112307]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829" returned: 1 in 0.824s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829' failed. Not Retrying. {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:23 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:23 devstack sudo[112323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829 Jun 19 04:34:23 devstack sudo[112323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:24 devstack sudo[112313]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0" returned: 0 in 0.837s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:24 devstack sudo[112326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.info Jun 19 04:34:24 devstack sudo[112326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:24 devstack sudo[112323]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-0b5ad442-043f-46a9-a4fe-d3bacbd1e829" returned: 0 in 0.869s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:24 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Lock "cinder-quobyte-0b5ad442-043f-46a9-a4fe-d3bacbd1e829" released by "delete_volume" :: held 2.627s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:24 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Created reservations ['4239d8ef-3491-4396-96e8-1da393065009', '6398a3cc-bb89-4937-b950-a94b20460351', 'c1a2bd1c-df9c-4f8f-a3d6-a7344f27c067', 'a0643c58-b1b6-41f2-88ab-75fb88958aa2'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:24 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:24 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:24 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:24 devstack sudo[112329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:24 devstack sudo[112329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:25 devstack sudo[112326]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.info" returned: 0 in 0.774s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:25 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.info is being set with open permissions: ugo+rw Jun 19 04:34:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:25 devstack sudo[112332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.info Jun 19 04:34:25 devstack sudo[112332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:25 devstack sudo[112329]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.819s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:25 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:25 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Deleted volume successfully. Jun 19 04:34:25 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-e9bfcd6f-bc60-4113-abec-dfe3ee975e80 tempest-VolumeImageDependencyTests-596756591 None] Lock "cinder-0b5ad442-043f-46a9-a4fe-d3bacbd1e829-delete_volume" released by "delete_volume" :: held 3.756s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:25 devstack sudo[112332]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.info" returned: 0 in 0.728s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.071s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.757s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:25 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] Creating offline snapshot a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 of volume e41dc90f-6f2e-4b49-887b-7ab23c8442e5 {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:34:25 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-b5824980-5bae-4a01-a3bb-20647ed59ef4 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Create snapshot completed successfully Jun 19 04:34:25 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e62ef1d-2416-4287-b3c2-069748f16f3a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:25 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:26 devstack sudo[112336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 Jun 19 04:34:26 devstack sudo[112336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:26 devstack sudo[112336]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5" returned: 0 in 0.999s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:26 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:27 devstack sudo[112341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 1G Jun 19 04:34:27 devstack sudo[112341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:27 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Flow 'volume_create_manager' (95e57173-c5b9-493b-922e-6568c24a695b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e58daf0-2366-468e-9276-17b77967b748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e58daf0-2366-468e-9276-17b77967b748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080264528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5247a3d-0720-4800-b7bf-db62bfb4e888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a00c0fc994a828628f9e0138a1227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:28Z,use_quota=True,user_id='4fba3d0d66494343ac35b01ebf7fcea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee44248-9675-405f-9360-bd50a9c11f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee44248-9675-405f-9360-bd50a9c11f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0876a4-af8b-492d-a044-2a1b558dcc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0876a4-af8b-492d-a044-2a1b558dcc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5247a3d-0720-4800-b7bf-db62bfb4e888', 'volume_name': 'volume-d5247a3d-0720-4800-b7bf-db62bfb4e888', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34d0da8-c4f9-4249-a2b4-49d9be98ab3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34d0da8-c4f9-4249-a2b4-49d9be98ab3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:27 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21cf721a-6f67-4d31-b2c6-a4bbc90e9ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:27 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume d5247a3d-0720-4800-b7bf-db62bfb4e888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5247a3d-0720-4800-b7bf-db62bfb4e888', 'volume_size': 1} Jun 19 04:34:27 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Flow 'volume_create_manager' (97a6dcea-5efd-475c-8c04-985e9234dc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1705168-b6c4-46ca-8da4-f568de5eb6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1705168-b6c4-46ca-8da4-f568de5eb6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2028783436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8bfe04-a290-4ba6-85bf-03f9254eb0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a00c0fc994a828628f9e0138a1227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:28Z,use_quota=True,user_id='4fba3d0d66494343ac35b01ebf7fcea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e0bb27-0436-4ee3-8d1b-121ca3c834a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e0bb27-0436-4ee3-8d1b-121ca3c834a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc59aee-6952-4ab7-af08-218dbb8466f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc59aee-6952-4ab7-af08-218dbb8466f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d8bfe04-a290-4ba6-85bf-03f9254eb0f0', 'volume_name': 'volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c790a3c5-690f-4f89-b42f-f38bcbb6acd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c790a3c5-690f-4f89-b42f-f38bcbb6acd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665eb172-6cae-450e-9f4f-33de048d8c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:28 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume 5d8bfe04-a290-4ba6-85bf-03f9254eb0f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0', 'volume_size': 1} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:28 devstack sudo[112341]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 1G" returned: 0 in 1.407s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:28 devstack sudo[112348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 Jun 19 04:34:28 devstack sudo[112348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Flow 'volume_create_manager' (a3a41e90-de4b-4a74-bb6e-7c486f945e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e9f14d-12e6-4182-aefe-2051727c4ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e9f14d-12e6-4182-aefe-2051727c4ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-893048584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f7bc11-ba67-44d0-8994-096bec5d3ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a00c0fc994a828628f9e0138a1227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:29Z,use_quota=True,user_id='4fba3d0d66494343ac35b01ebf7fcea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a53ad1-e085-4e3e-8d99-41fe44a9c8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a53ad1-e085-4e3e-8d99-41fe44a9c8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edde46af-f678-4715-bb8d-4c8b2635f7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edde46af-f678-4715-bb8d-4c8b2635f7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f7bc11-ba67-44d0-8994-096bec5d3ac5', 'volume_name': 'volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bfb39c-7c98-4e4f-aa40-7cba3ccb2e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bfb39c-7c98-4e4f-aa40-7cba3ccb2e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe9864b-2b65-49ea-b519-8b3ac5184fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:28 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume 74f7bc11-ba67-44d0-8994-096bec5d3ac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5', 'volume_size': 1} Jun 19 04:34:28 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Flow 'volume_create_manager' (7774cd01-a9f5-4d5e-8aa6-013ac44e0c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4806493c-bb8b-4ca3-b3cd-62e360cbb218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4806493c-bb8b-4ca3-b3cd-62e360cbb218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1831166212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180c32e2-1c08-4761-bf10-bba342fa6ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a00c0fc994a828628f9e0138a1227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:29Z,use_quota=True,user_id='4fba3d0d66494343ac35b01ebf7fcea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32600606-0df7-4897-b203-9c67a720c96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32600606-0df7-4897-b203-9c67a720c96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2466ae00-eb26-4ba3-a69b-fdf93b682967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2466ae00-eb26-4ba3-a69b-fdf93b682967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '180c32e2-1c08-4761-bf10-bba342fa6ce0', 'volume_name': 'volume-180c32e2-1c08-4761-bf10-bba342fa6ce0', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05bd1644-1f24-411f-b8ff-9dd3b1e53ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05bd1644-1f24-411f-b8ff-9dd3b1e53ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:29 devstack sudo[112348]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732732dd-c8f3-4120-b46c-be7c250530eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:29 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume 180c32e2-1c08-4761-bf10-bba342fa6ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-180c32e2-1c08-4761-bf10-bba342fa6ce0', 'volume_size': 1} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2" returned: 0 in 0.979s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:29 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 is being set with open permissions: ugo+rw Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:29 devstack sudo[112353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 Jun 19 04:34:29 devstack sudo[112353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Flow 'volume_create_manager' (79fba937-c2dd-43c8-b302-11178a3553fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4a1c42-12b3-4236-83ba-33e7a0d6c21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4a1c42-12b3-4236-83ba-33e7a0d6c21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-319122902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c159882b-eb50-47ca-bf22-9bd317ad1031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a00c0fc994a828628f9e0138a1227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:30Z,use_quota=True,user_id='4fba3d0d66494343ac35b01ebf7fcea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e359fa6-9617-4a24-94c8-4c90800c9a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e359fa6-9617-4a24-94c8-4c90800c9a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad6bffa-8446-433c-b5c4-1188e023c2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad6bffa-8446-433c-b5c4-1188e023c2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c159882b-eb50-47ca-bf22-9bd317ad1031', 'volume_name': 'volume-c159882b-eb50-47ca-bf22-9bd317ad1031', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02eaf449-0cf5-4d37-9ac9-e6c5d12c0c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02eaf449-0cf5-4d37-9ac9-e6c5d12c0c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b97018e-e68e-42ac-a581-e942d589493d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:29 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume c159882b-eb50-47ca-bf22-9bd317ad1031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c159882b-eb50-47ca-bf22-9bd317ad1031', 'volume_size': 1} Jun 19 04:34:29 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:30 devstack sudo[112353]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2" returned: 0 in 0.709s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:30 devstack sudo[112357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.info Jun 19 04:34:30 devstack sudo[112357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:30 devstack sudo[112357]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.info" returned: 0 in 0.712s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:30 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.info is being set with open permissions: ugo+rw Jun 19 04:34:30 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:30 devstack sudo[112360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.info Jun 19 04:34:30 devstack sudo[112360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:31 devstack sudo[112360]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.info" returned: 0 in 0.707s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.634s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.714s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080264528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5247a3d-0720-4800-b7bf-db62bfb4e888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a00c0fc994a828628f9e0138a1227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:28Z,use_quota=True,user_id='4fba3d0d66494343ac35b01ebf7fcea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Creating volume d5247a3d-0720-4800-b7bf-db62bfb4e888 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:31 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:31 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:34:31 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d5247a3d-0720-4800-b7bf-db62bfb4e888 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:31 devstack sudo[112363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d5247a3d-0720-4800-b7bf-db62bfb4e888 1073741824 Jun 19 04:34:31 devstack sudo[112363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:31 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-d10f39a6-fe5f-4052-af74-2f7dbe750d0b tempest-VolumeDependencyTests-993024082 None] Create snapshot completed successfully Jun 19 04:34:32 devstack sudo[112363]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d5247a3d-0720-4800-b7bf-db62bfb4e888 1073741824" returned: 0 in 0.925s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:32 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=129,cinder:UPDATE=189,cinder:INSERT=53,cinder:DELETE=16 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:34:32 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d5247a3d-0720-4800-b7bf-db62bfb4e888 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:32 devstack sudo[112369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d5247a3d-0720-4800-b7bf-db62bfb4e888 Jun 19 04:34:32 devstack sudo[112369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=156,cinder:UPDATE=187,cinder:INSERT=51,cinder:DELETE=19 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:33 devstack sudo[112369]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d5247a3d-0720-4800-b7bf-db62bfb4e888" returned: 0 in 0.766s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.031s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2028783436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8bfe04-a290-4ba6-85bf-03f9254eb0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a00c0fc994a828628f9e0138a1227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:28Z,use_quota=True,user_id='4fba3d0d66494343ac35b01ebf7fcea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Creating volume 5d8bfe04-a290-4ba6-85bf-03f9254eb0f0 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:33 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21cf721a-6f67-4d31-b2c6-a4bbc90e9ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5247a3d-0720-4800-b7bf-db62bfb4e888', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:33 devstack sudo[112372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0 1073741824 Jun 19 04:34:33 devstack sudo[112372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3d7e93-6854-47a4-859a-6892fed8367c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Flow 'volume_create_manager' (99368b1f-5df5-441b-b120-720178f1405f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35a37e5-a6de-409d-af11-1fe25742db69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35a37e5-a6de-409d-af11-1fe25742db69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1889718816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6c5903-52b2-4c5e-ac12-b73c4be3f087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15bf5e117bf4976a6fa5bc4d8dfb8a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1ef1418-10f8-4cb6-89a6-2f81684e5fa2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:33Z,use_quota=True,user_id='8e64c3d1d2f14d04ae0c7485eb2e81bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23bc37c1-600e-456f-a5bf-035fd49fa4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23bc37c1-600e-456f-a5bf-035fd49fa4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f2c1d1-4296-42de-be59-3dec034f0060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f2c1d1-4296-42de-be59-3dec034f0060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a6c5903-52b2-4c5e-ac12-b73c4be3f087', 'volume_name': 'volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087', 'volume_size': 1, 'snapshot_id': 'a1ef1418-10f8-4cb6-89a6-2f81684e5fa2'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0df507-4d2f-4edc-a7fc-bc45a3fede97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0df507-4d2f-4edc-a7fc-bc45a3fede97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5362eb-ae4b-4518-aac4-77f90b615437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:33 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Volume 2a6c5903-52b2-4c5e-ac12-b73c4be3f087: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087', 'volume_size': 1, 'snapshot_id': 'a1ef1418-10f8-4cb6-89a6-2f81684e5fa2'} Jun 19 04:34:33 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume volume-d5247a3d-0720-4800-b7bf-db62bfb4e888 (d5247a3d-0720-4800-b7bf-db62bfb4e888): created successfully Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3d7e93-6854-47a4-859a-6892fed8367c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Flow 'volume_create_manager' (95e57173-c5b9-493b-922e-6568c24a695b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:33 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:33 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-daae7648-fd14-47f5-845e-4213f0a17642 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Created volume successfully. Jun 19 04:34:34 devstack sudo[112372]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0 1073741824" returned: 0 in 0.928s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:34 devstack sudo[112378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0 Jun 19 04:34:34 devstack sudo[112378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:34 devstack sudo[112378]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0" returned: 0 in 0.676s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.121s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-893048584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f7bc11-ba67-44d0-8994-096bec5d3ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a00c0fc994a828628f9e0138a1227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:29Z,use_quota=True,user_id='4fba3d0d66494343ac35b01ebf7fcea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Creating volume 74f7bc11-ba67-44d0-8994-096bec5d3ac5 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:34 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:34:34 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665eb172-6cae-450e-9f4f-33de048d8c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82410345-3537-4f9e-a9a7-7dff0d471d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:35 devstack sudo[112381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5 1073741824 Jun 19 04:34:35 devstack sudo[112381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:35 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0 (5d8bfe04-a290-4ba6-85bf-03f9254eb0f0): created successfully Jun 19 04:34:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82410345-3537-4f9e-a9a7-7dff0d471d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:35 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Flow 'volume_create_manager' (97a6dcea-5efd-475c-8c04-985e9234dc20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:35 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8949272c-786c-41d4-bbbd-357d99cf0437 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Created volume successfully. Jun 19 04:34:35 devstack sudo[112381]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5 1073741824" returned: 0 in 0.914s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:35 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:35 devstack sudo[112387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5 Jun 19 04:34:35 devstack sudo[112387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:36 devstack sudo[112387]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5" returned: 0 in 0.746s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.317s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1831166212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180c32e2-1c08-4761-bf10-bba342fa6ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a00c0fc994a828628f9e0138a1227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:29Z,use_quota=True,user_id='4fba3d0d66494343ac35b01ebf7fcea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Creating volume 180c32e2-1c08-4761-bf10-bba342fa6ce0 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:36 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-180c32e2-1c08-4761-bf10-bba342fa6ce0 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:36 devstack sudo[112390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-180c32e2-1c08-4761-bf10-bba342fa6ce0 1073741824 Jun 19 04:34:36 devstack sudo[112390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe9864b-2b65-49ea-b519-8b3ac5184fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e835316b-2ad9-4858-9461-453f6ec31cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:36 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5 (74f7bc11-ba67-44d0-8994-096bec5d3ac5): created successfully Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e835316b-2ad9-4858-9461-453f6ec31cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:36 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Flow 'volume_create_manager' (a3a41e90-de4b-4a74-bb6e-7c486f945e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:36 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-60ba56cd-52a1-42ac-9d94-0047b068ae9a tempest-CreateVolumesFromSnapshotTest-1396312677 None] Created volume successfully. Jun 19 04:34:37 devstack sudo[112390]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-180c32e2-1c08-4761-bf10-bba342fa6ce0 1073741824" returned: 0 in 1.022s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:37 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-180c32e2-1c08-4761-bf10-bba342fa6ce0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:37 devstack sudo[112396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-180c32e2-1c08-4761-bf10-bba342fa6ce0 Jun 19 04:34:37 devstack sudo[112396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:38 devstack sudo[112396]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-180c32e2-1c08-4761-bf10-bba342fa6ce0" returned: 0 in 0.846s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.845s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-319122902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c159882b-eb50-47ca-bf22-9bd317ad1031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a00c0fc994a828628f9e0138a1227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:30Z,use_quota=True,user_id='4fba3d0d66494343ac35b01ebf7fcea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Creating volume c159882b-eb50-47ca-bf22-9bd317ad1031 {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:38 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c159882b-eb50-47ca-bf22-9bd317ad1031 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732732dd-c8f3-4120-b46c-be7c250530eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-180c32e2-1c08-4761-bf10-bba342fa6ce0', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:38 devstack sudo[112399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c159882b-eb50-47ca-bf22-9bd317ad1031 1073741824 Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e818fd-7552-4200-a778-952419b9e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:38 devstack sudo[112399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:38 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume volume-180c32e2-1c08-4761-bf10-bba342fa6ce0 (180c32e2-1c08-4761-bf10-bba342fa6ce0): created successfully Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e818fd-7552-4200-a778-952419b9e8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:38 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Flow 'volume_create_manager' (7774cd01-a9f5-4d5e-8aa6-013ac44e0c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:38 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8eba0a37-7c03-4e72-a1e5-be976328858c tempest-CreateVolumesFromSnapshotTest-1396312677 None] Created volume successfully. Jun 19 04:34:39 devstack sudo[112399]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c159882b-eb50-47ca-bf22-9bd317ad1031 1073741824" returned: 0 in 1.107s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:39 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c159882b-eb50-47ca-bf22-9bd317ad1031 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:39 devstack sudo[112406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c159882b-eb50-47ca-bf22-9bd317ad1031 Jun 19 04:34:39 devstack sudo[112406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:40 devstack sudo[112406]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c159882b-eb50-47ca-bf22-9bd317ad1031" returned: 0 in 0.696s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.987s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Acquiring lock "cinder-quobyte-a1ef1418-10f8-4cb6-89a6-2f81684e5fa2-2a6c5903-52b2-4c5e-ac12-b73c4be3f087" by "_create_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b97018e-e68e-42ac-a581-e942d589493d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c159882b-eb50-47ca-bf22-9bd317ad1031', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9dc61cc-4c9b-4694-b0cf-14a220b6f131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:40 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Volume volume-c159882b-eb50-47ca-bf22-9bd317ad1031 (c159882b-eb50-47ca-bf22-9bd317ad1031): created successfully Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9dc61cc-4c9b-4694-b0cf-14a220b6f131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Flow 'volume_create_manager' (79fba937-c2dd-43c8-b302-11178a3553fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-quobyte-a1ef1418-10f8-4cb6-89a6-2f81684e5fa2-2a6c5903-52b2-4c5e-ac12-b73c4be3f087" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Creating volume 2a6c5903-52b2-4c5e-ac12-b73c4be3f087 from snapshot a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 {{(pid=93300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Acquiring lock "cinder-quobyte-2a6c5903-52b2-4c5e-ac12-b73c4be3f087" by "_copy_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:40 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-aa058466-f6b8-4b8f-b173-3ef8505a236b tempest-CreateVolumesFromSnapshotTest-1396312677 None] Created volume successfully. Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-quobyte-2a6c5903-52b2-4c5e-ac12-b73c4be3f087" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] snapshot: a1ef1418-10f8-4cb6-89a6-2f81684e5fa2, volume: 2a6c5903-52b2-4c5e-ac12-b73c4be3f087, {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b0567e-ad37-4978-92d3-0ef792b5bbe5]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-c159882b-eb50-47ca-bf22-9bd317ad1031-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-c159882b-eb50-47ca-bf22-9bd317ad1031-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-quobyte-c159882b-eb50-47ca-bf22-9bd317ad1031" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-c159882b-eb50-47ca-bf22-9bd317ad1031" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:40 devstack sudo[112409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 Jun 19 04:34:40 devstack sudo[112409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6a65db-ce9b-428b-8783-98f16d2bd9d1]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:40 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c159882b-eb50-47ca-bf22-9bd317ad1031 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:40 devstack sudo[112411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c159882b-eb50-47ca-bf22-9bd317ad1031 Jun 19 04:34:40 devstack sudo[112411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:41 devstack sudo[112409]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2" returned: 0 in 0.823s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:34:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:34:41 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Creating direct copy from snapshot {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:34:41 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc94b38-10e7-4d87-b926-8e83f4690b1e]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:41 devstack sudo[112418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 Jun 19 04:34:41 devstack sudo[112418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:41 devstack sudo[112411]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c159882b-eb50-47ca-bf22-9bd317ad1031" returned: 0 in 0.828s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:41 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c159882b-eb50-47ca-bf22-9bd317ad1031 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:41 devstack sudo[112421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c159882b-eb50-47ca-bf22-9bd317ad1031 Jun 19 04:34:41 devstack sudo[112421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:42 devstack sudo[112421]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-c159882b-eb50-47ca-bf22-9bd317ad1031" returned: 0 in 0.845s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:42 devstack sudo[112418]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5" returned: 0 in 0.992s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG cinder.utils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Path /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087 not found in is_blk_device check {{(pid=93300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-c159882b-eb50-47ca-bf22-9bd317ad1031" released by "delete_volume" :: held 1.732s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:42 devstack sudo[112428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087 Jun 19 04:34:42 devstack sudo[112428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Created reservations ['93da0f17-8884-4122-a3a3-1c6063ec4dc4', '6410d54b-d640-4c5c-9f4c-9070e777a80d', '81763f62-4b56-4713-819b-82e7a29f84a1', 'a38d665a-f09a-4a36-a8c9-a8f1a1019806'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:42 devstack sudo[112430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:42 devstack sudo[112430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-180c32e2-1c08-4761-bf10-bba342fa6ce0-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:42 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-180c32e2-1c08-4761-bf10-bba342fa6ce0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-quobyte-180c32e2-1c08-4761-bf10-bba342fa6ce0" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-180c32e2-1c08-4761-bf10-bba342fa6ce0" acquired by "delete_volume" :: waited 0.019s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:43 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1507ae2-d06d-4793-944b-17ab9eea368a]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-180c32e2-1c08-4761-bf10-bba342fa6ce0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:43 devstack sudo[112432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-180c32e2-1c08-4761-bf10-bba342fa6ce0 Jun 19 04:34:43 devstack sudo[112432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:43 devstack sudo[112430]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:43 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.907s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:43 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:43 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Deleted volume successfully. Jun 19 04:34:43 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-8760de76-c8b2-419f-ae8c-ef372654dad8 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-c159882b-eb50-47ca-bf22-9bd317ad1031-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Flow 'volume_create_manager' (c7eb8851-abb1-46fd-9599-e5e312a2a446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7a4dbd-ec2d-4b46-b636-c605ec7d31e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7a4dbd-ec2d-4b46-b636-c605ec7d31e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-935594612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fec95f6-7545-472e-896d-8c2d1184e74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76398f28e1cd4fceaf2d7a7fd58efe24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:44Z,use_quota=True,user_id='2db82b7936024725a69f522ae9bc8329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7456e67-8c19-4bef-a383-ec1b723d773d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7456e67-8c19-4bef-a383-ec1b723d773d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e36fa35-4102-4cd2-80f2-f0201b3bfcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e36fa35-4102-4cd2-80f2-f0201b3bfcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fec95f6-7545-472e-896d-8c2d1184e74b', 'volume_name': 'volume-8fec95f6-7545-472e-896d-8c2d1184e74b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c5089e-ab90-48c1-ae57-774f4de63737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c5089e-ab90-48c1-ae57-774f4de63737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88bdb85e-74db-44a5-93c3-c23f29471225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:44 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Volume 8fec95f6-7545-472e-896d-8c2d1184e74b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fec95f6-7545-472e-896d-8c2d1184e74b', 'volume_size': 1} Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:44 devstack sudo[112432]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-180c32e2-1c08-4761-bf10-bba342fa6ce0" returned: 0 in 1.777s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:44 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-180c32e2-1c08-4761-bf10-bba342fa6ce0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:44 devstack sudo[112484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-180c32e2-1c08-4761-bf10-bba342fa6ce0 Jun 19 04:34:44 devstack sudo[112484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:46 devstack sudo[112484]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-180c32e2-1c08-4761-bf10-bba342fa6ce0" returned: 0 in 1.434s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-180c32e2-1c08-4761-bf10-bba342fa6ce0" released by "delete_volume" :: held 3.301s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Created reservations ['a22acb89-348e-409f-83bb-97951daefe14', '1dc7af91-c339-41ae-9e8e-e9f693cbf184', '5d3333a3-0f37-41ae-a299-ad2cbb27ba94', 'abdbeea5-5b5a-40ba-8287-97925a683787'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:46 devstack sudo[112488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:46 devstack sudo[112488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-74f7bc11-ba67-44d0-8994-096bec5d3ac5-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-74f7bc11-ba67-44d0-8994-096bec5d3ac5-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-quobyte-74f7bc11-ba67-44d0-8994-096bec5d3ac5" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-74f7bc11-ba67-44d0-8994-096bec5d3ac5" acquired by "delete_volume" :: waited 0.033s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a157af-9e47-438b-8aca-0637ec73fd8b]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:46 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:47 devstack sudo[112490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5 Jun 19 04:34:47 devstack sudo[112490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:47 devstack sudo[112488]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:47 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 1.290s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:47 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:47 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Deleted volume successfully. Jun 19 04:34:47 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-21660974-1393-41d9-ad55-51e0288faf51 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-180c32e2-1c08-4761-bf10-bba342fa6ce0-delete_volume" released by "delete_volume" :: held 4.972s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:48 devstack sudo[112428]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087" returned: 0 in 6.003s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:48 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f764ba-a085-42b1-8531-26bd49928444]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:48 devstack sudo[112493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 Jun 19 04:34:48 devstack sudo[112493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:48 devstack sudo[112490]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5" returned: 0 in 1.707s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:48 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:48 devstack sudo[112498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5 Jun 19 04:34:48 devstack sudo[112498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:49 devstack sudo[112498]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-74f7bc11-ba67-44d0-8994-096bec5d3ac5" returned: 0 in 0.638s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:49 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-74f7bc11-ba67-44d0-8994-096bec5d3ac5" released by "delete_volume" :: held 2.415s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:49 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Created reservations ['fce02955-8498-45a6-a47a-a4ec9ab519a3', '2bb6f9d5-c0a0-435f-9f53-e3e77b81a1eb', 'c5e4db30-269f-4c84-b922-c6550828724c', '0e94d9a0-7161-4800-a9b3-28d9d6e88ee2'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:49 devstack sudo[112493]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5" returned: 0 in 0.922s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:49 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:34:49 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Converted 1024.00 MB image at 170.56 MB/s Jun 19 04:34:49 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087 is being set with open permissions: ugo+rw Jun 19 04:34:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:49 devstack sudo[112505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087 Jun 19 04:34:49 devstack sudo[112505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:49 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:49 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:49 devstack sudo[112507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:49 devstack sudo[112507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:50 devstack sudo[112505]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087" returned: 0 in 0.643s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-quobyte-2a6c5903-52b2-4c5e-ac12-b73c4be3f087" released by "_copy_volume_from_snapshot" :: held 9.522s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:50 devstack sudo[112507]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.621s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-quobyte-a1ef1418-10f8-4cb6-89a6-2f81684e5fa2-2a6c5903-52b2-4c5e-ac12-b73c4be3f087" released by "_create_volume_from_snapshot" :: held 9.572s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.626s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.713s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-935594612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fec95f6-7545-472e-896d-8c2d1184e74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76398f28e1cd4fceaf2d7a7fd58efe24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:44Z,use_quota=True,user_id='2db82b7936024725a69f522ae9bc8329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)}" {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Creating volume 8fec95f6-7545-472e-896d-8c2d1184e74b {{(pid=93300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:50 devstack cinder-volume[93300]: INFO cinder.volume.drivers.remotefs [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] casted to osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b 1073741824 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:50 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Deleted volume successfully. Jun 19 04:34:50 devstack sudo[112512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b 1073741824 Jun 19 04:34:50 devstack sudo[112512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5362eb-ae4b-4518-aac4-77f90b615437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087', 'volume_size': 1, 'snapshot_id': 'a1ef1418-10f8-4cb6-89a6-2f81684e5fa2'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865d2168-eb89-4af5-af65-77738d88b1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-9b22640d-3499-4c53-9690-372cf9ba1ddd tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-74f7bc11-ba67-44d0-8994-096bec5d3ac5-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:50 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Volume volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087 (2a6c5903-52b2-4c5e-ac12-b73c4be3f087): created successfully Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865d2168-eb89-4af5-af65-77738d88b1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Flow 'volume_create_manager' (99368b1f-5df5-441b-b120-720178f1405f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:50 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-83e3faa1-c2cb-477d-bc6e-cffb18ad4237 tempest-VolumeDependencyTests-993024082 None] Created volume successfully. Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-quobyte-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0" acquired by "delete_volume" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2c38ca-5857-4515-8d2d-1226e9303fcf]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:50 devstack sudo[112514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0 Jun 19 04:34:50 devstack sudo[112514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Acquiring lock "cinder-a1ef1418-10f8-4cb6-89a6-2f81684e5fa2-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-a1ef1418-10f8-4cb6-89a6-2f81684e5fa2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Acquiring lock "cinder-quobyte-e41dc90f-6f2e-4b49-887b-7ab23c8442e5" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-quobyte-e41dc90f-6f2e-4b49-887b-7ab23c8442e5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Acquiring lock "cinder-quobyte-a1ef1418-10f8-4cb6-89a6-2f81684e5fa2" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-quobyte-a1ef1418-10f8-4cb6-89a6-2f81684e5fa2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Deleting offline snapshot a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 of volume e41dc90f-6f2e-4b49-887b-7ab23c8442e5 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] snapshot_file for this snap is: volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ceeb69-4a28-40cb-b5a2-c670e8ff9fe6]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:50 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:50 devstack sudo[112522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 Jun 19 04:34:50 devstack sudo[112522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:51 devstack sudo[112512]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b 1073741824" returned: 0 in 0.893s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:51 devstack sudo[112528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b Jun 19 04:34:51 devstack sudo[112528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:51 devstack sudo[112514]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0" returned: 0 in 0.768s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:51 devstack sudo[112530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0 Jun 19 04:34:51 devstack sudo[112530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:51 devstack sudo[112522]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2" returned: 0 in 0.839s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:34:51 devstack sudo[112528]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b" returned: 0 in 0.657s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'} {{(pid=93300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32078e7-8bf1-4f29-98a4-6d45058e0a39]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88bdb85e-74db-44a5-93c3-c23f29471225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fec95f6-7545-472e-896d-8c2d1184e74b', 'volume_size': 1}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1c5611-b6cd-4d80-b473-570705fe185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:51 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Volume volume-8fec95f6-7545-472e-896d-8c2d1184e74b (8fec95f6-7545-472e-896d-8c2d1184e74b): created successfully Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1c5611-b6cd-4d80-b473-570705fe185a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Flow 'volume_create_manager' (c7eb8851-abb1-46fd-9599-e5e312a2a446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:51 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-4a431fc0-9e22-432c-99d0-34b7ab3af6dd tempest-SnapshotDependencyTests-125100076 None] Created volume successfully. Jun 19 04:34:51 devstack sudo[112537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 Jun 19 04:34:51 devstack sudo[112537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:51 devstack sudo[112530]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0" returned: 0 in 0.682s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0" released by "delete_volume" :: held 1.496s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Created reservations ['0565b31e-d82a-40dc-9433-bf46cd99d413', 'c17083c2-4b9d-41b1-9d11-747f025bcef0', '95bef132-5233-469b-bc62-701ebdedabd9', '7561abfe-8d6c-4b72-b6a9-c2094e803df8'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:51 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:51 devstack sudo[112539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:51 devstack sudo[112539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:52 devstack sudo[112537]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5" returned: 0 in 0.771s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:52 devstack sudo[112544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 Jun 19 04:34:52 devstack sudo[112544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-d5247a3d-0720-4800-b7bf-db62bfb4e888-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-d5247a3d-0720-4800-b7bf-db62bfb4e888-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:52 devstack sudo[112539]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-quobyte-d5247a3d-0720-4800-b7bf-db62bfb4e888" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.670s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:52 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:52 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Deleted volume successfully. Jun 19 04:34:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-d5247a3d-0720-4800-b7bf-db62bfb4e888" acquired by "delete_volume" :: waited 0.029s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:52 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f33af249-945f-4050-9028-df8056e2f0b3 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-5d8bfe04-a290-4ba6-85bf-03f9254eb0f0-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:52 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[174c60e4-589f-4678-8096-25ed1f99ba93]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:52 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d5247a3d-0720-4800-b7bf-db62bfb4e888 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:52 devstack sudo[112547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d5247a3d-0720-4800-b7bf-db62bfb4e888 Jun 19 04:34:52 devstack sudo[112547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] Creating offline snapshot 0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b of volume 8fec95f6-7545-472e-896d-8c2d1184e74b {{(pid=93300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd938a7-8750-4323-98b2-c6d556e2f59e]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:53 devstack sudo[112551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b Jun 19 04:34:53 devstack sudo[112551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:53 devstack sudo[112544]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2" returned: 0 in 0.785s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:53 devstack sudo[112554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2 Jun 19 04:34:53 devstack sudo[112554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:53 devstack sudo[112547]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d5247a3d-0720-4800-b7bf-db62bfb4e888" returned: 0 in 0.822s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d5247a3d-0720-4800-b7bf-db62bfb4e888 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:53 devstack sudo[112559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d5247a3d-0720-4800-b7bf-db62bfb4e888 Jun 19 04:34:53 devstack sudo[112559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:53 devstack sudo[112551]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b" returned: 0 in 0.818s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b 1G {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:53 devstack sudo[112554]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5.a1ef1418-10f8-4cb6-89a6-2f81684e5fa2" returned: 0 in 0.654s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:53 devstack sudo[112565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b 1G Jun 19 04:34:53 devstack sudo[112565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-quobyte-a1ef1418-10f8-4cb6-89a6-2f81684e5fa2" released by "_delete_snapshot" :: held 3.153s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:53 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-quobyte-e41dc90f-6f2e-4b49-887b-7ab23c8442e5" released by "delete_snapshot" :: held 3.179s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Created reservations ['ea8b0e4e-bc8d-4fd7-b70e-812c7684adac', '41f733b5-ee1d-4ef1-a0d0-f92177100ba0', '74a980f3-8ff5-4f54-bd75-9337fd124425', '4e5a995f-2648-4462-bbef-655314b84b26'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:54 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Delete snapshot completed successfully. Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-f620a5ec-1ebe-418f-a18a-8f302879a7e6 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-a1ef1418-10f8-4cb6-89a6-2f81684e5fa2-delete_snapshot" released by "delete_snapshot" :: held 3.353s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:54 devstack sudo[112559]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-d5247a3d-0720-4800-b7bf-db62bfb4e888" returned: 0 in 0.666s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-d5247a3d-0720-4800-b7bf-db62bfb4e888" released by "delete_volume" :: held 1.551s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Created reservations ['3ec28157-39ff-40a8-843a-a9cf791ce2fe', 'f8509c2e-876c-4b2b-8d1d-9840f8d70ea9', '855fc75d-9ad3-4522-acf0-fc88aa5e7a28', '75ba0cce-9afd-4b57-a6d0-46d2be32da82'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:54 devstack sudo[112568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:54 devstack sudo[112568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:54 devstack sudo[112565]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b 1G" returned: 0 in 0.795s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fec95f6-7545-472e-896d-8c2d1184e74b -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:54 devstack sudo[112573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fec95f6-7545-472e-896d-8c2d1184e74b -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b Jun 19 04:34:54 devstack sudo[112573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-d33d040e-5d6e-4df5-9221-11c1485afae0-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-d33d040e-5d6e-4df5-9221-11c1485afae0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-quobyte-61880794-7e37-4b37-913e-24c1dce186ef" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-61880794-7e37-4b37-913e-24c1dce186ef" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-quobyte-d33d040e-5d6e-4df5-9221-11c1485afae0" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-d33d040e-5d6e-4df5-9221-11c1485afae0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Deleting offline snapshot d33d040e-5d6e-4df5-9221-11c1485afae0 of volume 61880794-7e37-4b37-913e-24c1dce186ef {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] snapshot_file for this snap is: volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce270bd6-056c-4db1-bdd2-a7778e8f8c87]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:54 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:55 devstack sudo[112568]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.686s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:55 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Deleted volume successfully. Jun 19 04:34:55 devstack sudo[112576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 Jun 19 04:34:55 devstack sudo[112576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Acquiring lock "cinder-e41dc90f-6f2e-4b49-887b-7ab23c8442e5-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-673764a0-8e20-4715-9b19-23d70d6dfccc tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-d5247a3d-0720-4800-b7bf-db62bfb4e888-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-e41dc90f-6f2e-4b49-887b-7ab23c8442e5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Acquiring lock "cinder-quobyte-e41dc90f-6f2e-4b49-887b-7ab23c8442e5" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-quobyte-e41dc90f-6f2e-4b49-887b-7ab23c8442e5" acquired by "delete_volume" :: waited 0.029s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[75202712-ad9b-41fd-b2bd-7d210ae93d53]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:55 devstack sudo[112578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 Jun 19 04:34:55 devstack sudo[112578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:55 devstack sudo[112573]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fec95f6-7545-472e-896d-8c2d1184e74b -F qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b" returned: 0 in 0.735s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:55 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b is being set with open permissions: ugo+rw Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:55 devstack sudo[112583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b Jun 19 04:34:55 devstack sudo[112583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:55 devstack sudo[112576]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0" returned: 0 in 0.898s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61880794-7e37-4b37-913e-24c1dce186ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae28285-b4ca-48ad-8c60-2abb7c7363e0]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:55 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:55 devstack sudo[112588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef Jun 19 04:34:55 devstack sudo[112588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:56 devstack sudo[112578]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5" returned: 0 in 0.791s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:56 devstack sudo[112594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5 Jun 19 04:34:56 devstack sudo[112594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:56 devstack sudo[112583]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b" returned: 0 in 0.670s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:56 devstack sudo[112596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.info Jun 19 04:34:56 devstack sudo[112596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:56 devstack sudo[112588]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef" returned: 0 in 0.795s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:56 devstack sudo[112602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 Jun 19 04:34:56 devstack sudo[112602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:56 devstack sudo[112594]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-e41dc90f-6f2e-4b49-887b-7ab23c8442e5" returned: 0 in 0.663s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-quobyte-e41dc90f-6f2e-4b49-887b-7ab23c8442e5" released by "delete_volume" :: held 1.523s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Created reservations ['355ee3a0-54b4-4cf0-b2c8-6da37d850472', '9db4bf63-34b3-4308-a5e3-2afc9466a1ce', '83707483-42c0-42cb-ace8-c724932c28d0', 'ec683186-1582-4501-8f5d-3f2b86e8b222'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:56 devstack sudo[112596]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.info" returned: 0 in 0.690s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:56 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.info is being set with open permissions: ugo+rw Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.info {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:56 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:56 devstack sudo[112605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.info Jun 19 04:34:56 devstack sudo[112605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:56 devstack sudo[112606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:56 devstack sudo[112606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Acquiring lock "cinder-2a6c5903-52b2-4c5e-ac12-b73c4be3f087-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Lock "cinder-2a6c5903-52b2-4c5e-ac12-b73c4be3f087-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Acquiring lock "cinder-quobyte-2a6c5903-52b2-4c5e-ac12-b73c4be3f087" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Lock "cinder-quobyte-2a6c5903-52b2-4c5e-ac12-b73c4be3f087" acquired by "delete_volume" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:57 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dbef50-633b-4852-baaf-3596a4caccf2]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:57 devstack sudo[112602]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0" returned: 0 in 0.868s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:57 devstack sudo[112615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0 Jun 19 04:34:57 devstack sudo[112615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:57 devstack sudo[112605]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.info" returned: 0 in 0.724s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.529s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:57 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-a0252296-d006-4e6a-bfdb-fcef00af3654 tempest-SnapshotDependencyTests-125100076 None] Create snapshot completed successfully Jun 19 04:34:57 devstack sudo[112613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087 Jun 19 04:34:57 devstack sudo[112613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:57 devstack sudo[112606]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:57 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.813s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:57 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:57 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Deleted volume successfully. Jun 19 04:34:57 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-ed8b2e62-3106-4d28-9ccd-76f2aeff4087 tempest-VolumeDependencyTests-993024082 None] Lock "cinder-e41dc90f-6f2e-4b49-887b-7ab23c8442e5-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:58 devstack sudo[112615]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef.d33d040e-5d6e-4df5-9221-11c1485afae0" returned: 0 in 0.660s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-d33d040e-5d6e-4df5-9221-11c1485afae0" released by "_delete_snapshot" :: held 3.333s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-61880794-7e37-4b37-913e-24c1dce186ef" released by "delete_snapshot" :: held 3.357s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:58 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Created reservations ['6c8a47ea-f930-4c4e-98c9-e65664105f99', '1ec75b85-8d89-439c-8a00-a3e53285360e', '60020b58-fe38-4f51-8535-6d556b85fc35', 'b6ca3616-7033-43b7-b890-67d28693a7da'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:58 devstack sudo[112613]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087" returned: 0 in 0.854s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:58 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:58 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Delete snapshot completed successfully. Jun 19 04:34:58 devstack sudo[112622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087 Jun 19 04:34:58 devstack sudo[112622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:58 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-0ae15a66-9040-4a22-884b-b27fc50449d5 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-d33d040e-5d6e-4df5-9221-11c1485afae0-delete_snapshot" released by "delete_snapshot" :: held 3.549s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:58 devstack cinder-volume[93300]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:58 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Flow 'volume_create_manager' (b0c4b4fb-aa85-42fc-b7e2-2c4a42cc7046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:58 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cc3fca-4559-40bf-b6a2-5d85275c1072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:58 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cc3fca-4559-40bf-b6a2-5d85275c1072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748a356e-500d-4134-a83f-32e7d660cc87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76398f28e1cd4fceaf2d7a7fd58efe24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:59Z,use_quota=True,user_id='2db82b7936024725a69f522ae9bc8329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f463b0d3-cb77-489e-b2f8-1b15067f169f),volume_type_id=f463b0d3-cb77-489e-b2f8-1b15067f169f)' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:58 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c7091a-9423-46de-a0f8-2dc848d7b96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c7091a-9423-46de-a0f8-2dc848d7b96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c8cefe-19e1-4f92-b2f8-2eaeb50340f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:59 devstack sudo[112622]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c8cefe-19e1-4f92-b2f8-2eaeb50340f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '748a356e-500d-4134-a83f-32e7d660cc87', 'volume_name': 'volume-748a356e-500d-4134-a83f-32e7d660cc87', 'volume_size': 1, 'snapshot_id': '0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35054bf-41de-4fb5-a1cd-5be190134930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35054bf-41de-4fb5-a1cd-5be190134930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae8a060-d984-4a14-82e4-8f37b054ed02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:59 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Volume 748a356e-500d-4134-a83f-32e7d660cc87: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-748a356e-500d-4134-a83f-32e7d660cc87', 'volume_size': 1, 'snapshot_id': '0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b'} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-2a6c5903-52b2-4c5e-ac12-b73c4be3f087" returned: 0 in 0.700s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-61880794-7e37-4b37-913e-24c1dce186ef-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "cinder-quobyte-0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b-748a356e-500d-4134-a83f-32e7d660cc87" by "_create_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Lock "cinder-quobyte-2a6c5903-52b2-4c5e-ac12-b73c4be3f087" released by "delete_volume" :: held 1.627s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-61880794-7e37-4b37-913e-24c1dce186ef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-quobyte-0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b-748a356e-500d-4134-a83f-32e7d660cc87" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Creating volume 748a356e-500d-4134-a83f-32e7d660cc87 from snapshot 0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b {{(pid=93300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Selected osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b as target Quobyte volume. {{(pid=93300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "cinder-quobyte-748a356e-500d-4134-a83f-32e7d660cc87" by "_copy_volume_from_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-quobyte-748a356e-500d-4134-a83f-32e7d660cc87" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] snapshot: 0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b, volume: 748a356e-500d-4134-a83f-32e7d660cc87, {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "cinder-quobyte-61880794-7e37-4b37-913e-24c1dce186ef" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a522dc95-b30c-4703-9c55-9f820cc2381c]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Created reservations ['21efb4bf-ec19-4912-8eab-26423bd38dff', 'f47a4390-3cbc-4776-b106-2f1a1f1e3b78', 'dbadcf5a-b8a8-4f65-b364-be676946eab8', '9894f58b-39a1-49ea-b1a5-6920e7876757'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-61880794-7e37-4b37-913e-24c1dce186ef" acquired by "delete_volume" :: waited 0.039s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b80ff4-334c-484f-b6d2-5c94a2117364]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:59 devstack sudo[112625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b Jun 19 04:34:59 devstack sudo[112625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:59 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:59 devstack sudo[112628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:34:59 devstack sudo[112628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:59 devstack sudo[112626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef Jun 19 04:34:59 devstack sudo[112626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:00 devstack sudo[112625]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b" returned: 0 in 0.871s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fec95f6-7545-472e-896d-8c2d1184e74b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Creating direct copy from snapshot {{(pid=93300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9fda60-f50f-4d3e-a525-b8974a559bb4]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:00 devstack sudo[112628]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.758s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:00 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Deleted volume successfully. Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-dc3eb231-29cf-4120-b88b-4585223688ef tempest-VolumeDependencyTests-993024082 None] Lock "cinder-2a6c5903-52b2-4c5e-ac12-b73c4be3f087-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:00 devstack sudo[112626]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef" returned: 0 in 0.879s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:00 devstack sudo[112641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef Jun 19 04:35:00 devstack sudo[112641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:00 devstack sudo[112640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b Jun 19 04:35:00 devstack sudo[112640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:00 devstack sudo[112641]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-61880794-7e37-4b37-913e-24c1dce186ef" returned: 0 in 0.757s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-quobyte-61880794-7e37-4b37-913e-24c1dce186ef" released by "delete_volume" :: held 1.716s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:00 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Created reservations ['ed119c1f-487d-4f20-993d-b48faedb0b98', '81bb1e87-6e91-48f6-9a4d-51eb60b41bcc', '230388f0-ee64-4920-8cdc-ca8b8dfcd1b6', '359e5ef8-6c4b-413b-8411-bdab757848d5'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:01 devstack sudo[112640]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b" returned: 0 in 0.951s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:01 devstack cinder-volume[93300]: DEBUG cinder.utils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Path /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87 not found in is_blk_device check {{(pid=93300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:35:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:01 devstack sudo[112648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87 Jun 19 04:35:01 devstack sudo[112648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:01 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:01 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:01 devstack sudo[112650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:35:01 devstack sudo[112650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:02 devstack sudo[112650]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:02 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.907s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:02 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:02 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Deleted volume successfully. Jun 19 04:35:02 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-91747d9f-560d-4f17-b0f9-0b7649e13ae2 tempest-CreateVolumesFromSnapshotTest-1396312677 None] Lock "cinder-61880794-7e37-4b37-913e-24c1dce186ef-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:05 devstack sudo[112648]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87" returned: 0 in 4.853s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:05 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9155d30-ce89-427d-a7b8-e8da793f2918]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:05 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:05 devstack sudo[112667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b Jun 19 04:35:05 devstack sudo[112667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:06 devstack sudo[112667]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b" returned: 0 in 0.881s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:06 devstack cinder-volume[93300]: DEBUG cinder.image.image_utils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87 {{(pid=93300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:35:06 devstack cinder-volume[93300]: INFO cinder.image.image_utils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Converted 1024.00 MB image at 210.97 MB/s Jun 19 04:35:06 devstack cinder-volume[93300]: WARNING cinder.volume.drivers.remotefs [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87 is being set with open permissions: ugo+rw Jun 19 04:35:06 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:06 devstack sudo[112672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87 Jun 19 04:35:06 devstack sudo[112672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:07 devstack sudo[112672]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87" returned: 0 in 0.610s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-quobyte-748a356e-500d-4134-a83f-32e7d660cc87" released by "_copy_volume_from_snapshot" :: held 8.274s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-quobyte-0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b-748a356e-500d-4134-a83f-32e7d660cc87" released by "_create_volume_from_snapshot" :: held 8.320s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.346s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae8a060-d984-4a14-82e4-8f37b054ed02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748a356e-500d-4134-a83f-32e7d660cc87', 'volume_size': 1, 'snapshot_id': '0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b'}' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e608f69e-5960-49e8-a11e-f42c9db1d51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:07 devstack cinder-volume[93300]: INFO cinder.volume.flows.manager.create_volume [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Volume volume-748a356e-500d-4134-a83f-32e7d660cc87 (748a356e-500d-4134-a83f-32e7d660cc87): created successfully Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e608f69e-5960-49e8-a11e-f42c9db1d51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Flow 'volume_create_manager' (b0c4b4fb-aa85-42fc-b7e2-2c4a42cc7046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:07 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-6c5b2b67-7bd4-4cc5-b493-e91114114cc8 tempest-SnapshotDependencyTests-125100076 None] Created volume successfully. Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "cinder-0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b-delete_snapshot" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "cinder-quobyte-8fec95f6-7545-472e-896d-8c2d1184e74b" by "delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-quobyte-8fec95f6-7545-472e-896d-8c2d1184e74b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "cinder-quobyte-0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b" by "_delete_snapshot" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-quobyte-0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Deleting offline snapshot 0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b of volume 8fec95f6-7545-472e-896d-8c2d1184e74b {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] snapshot_file for this snap is: volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b {{(pid=93300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac77aff-2ab7-48d0-b728-69366c8ef31f]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:07 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:08 devstack sudo[112675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b Jun 19 04:35:08 devstack sudo[112675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:08 devstack sudo[112675]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b" returned: 0 in 0.778s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:08 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.remotefs [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fec95f6-7545-472e-896d-8c2d1184e74b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:35:08 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e04e824-462b-40c2-befd-41eb8cbfda20]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:08 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:08 devstack sudo[112680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b Jun 19 04:35:08 devstack sudo[112680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:09 devstack sudo[112680]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b" returned: 0 in 0.719s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:09 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:09 devstack sudo[112686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b Jun 19 04:35:09 devstack sudo[112686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:10 devstack sudo[112686]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b" returned: 0 in 0.713s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:10 devstack sudo[112692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b Jun 19 04:35:10 devstack sudo[112692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:10 devstack sudo[112692]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:10 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b.0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b" returned: 0 in 0.662s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-quobyte-0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b" released by "_delete_snapshot" :: held 2.968s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:10 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-quobyte-8fec95f6-7545-472e-896d-8c2d1184e74b" released by "delete_snapshot" :: held 2.990s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:10 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Created reservations ['6f8be0c3-3983-4337-a9d1-f65b7cfe395a', '957988cc-a780-47e2-b9f2-a975bdd38902', '39942220-c567-47df-8bdf-76809efda404', '7e0102d0-c4ca-4277-be29-35cf601944a2'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:11 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Delete snapshot completed successfully. Jun 19 04:35:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-c88092b6-9750-49af-88e8-923c074ab443 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-0d0a2e1d-8e5e-4d3d-be9d-964c6fa7fc9b-delete_snapshot" released by "delete_snapshot" :: held 3.121s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "cinder-8fec95f6-7545-472e-896d-8c2d1184e74b-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-8fec95f6-7545-472e-896d-8c2d1184e74b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "cinder-quobyte-8fec95f6-7545-472e-896d-8c2d1184e74b" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:11 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-quobyte-8fec95f6-7545-472e-896d-8c2d1184e74b" acquired by "delete_volume" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:11 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a418d169-282c-4652-ae5e-fbbb09e1f867]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:11 devstack sudo[112695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b Jun 19 04:35:11 devstack sudo[112695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:11 devstack sudo[112695]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b" returned: 0 in 0.726s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:11 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:11 devstack sudo[112701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b Jun 19 04:35:11 devstack sudo[112701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:12 devstack sudo[112701]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-8fec95f6-7545-472e-896d-8c2d1184e74b" returned: 0 in 0.616s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:12 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-quobyte-8fec95f6-7545-472e-896d-8c2d1184e74b" released by "delete_volume" :: held 1.397s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:12 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Created reservations ['a0f39933-1d50-4781-8724-c64e447bb6c0', 'c88f523a-d971-469a-a283-28362ef6a13c', '0c0846ff-b32d-4119-afd9-3a7999d3eb2b', '7c4c3590-e77f-44aa-81ed-6ef1eadb2c45'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:12 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:12 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:12 devstack sudo[112704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:35:12 devstack sudo[112704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:13 devstack sudo[112704]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.640s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:13 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:13 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Deleted volume successfully. Jun 19 04:35:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "cinder-748a356e-500d-4134-a83f-32e7d660cc87-delete_volume" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-de607069-dbbe-43ac-a730-fc1121c3db31 tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-8fec95f6-7545-472e-896d-8c2d1184e74b-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-748a356e-500d-4134-a83f-32e7d660cc87-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "cinder-quobyte-748a356e-500d-4134-a83f-32e7d660cc87" by "delete_volume" {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:13 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-quobyte-748a356e-500d-4134-a83f-32e7d660cc87" acquired by "delete_volume" :: waited 0.018s {{(pid=93300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:13 devstack cinder-volume[93300]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ec69d6-3012-4e84-9465-82acd935ea4d]: (4, 'qcow2') {{(pid=94600) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:13 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:13 devstack sudo[112707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87 Jun 19 04:35:13 devstack sudo[112707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:14 devstack sudo[112707]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87" returned: 0 in 0.748s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87 {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:14 devstack sudo[112713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87 Jun 19 04:35:14 devstack sudo[112713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:14 devstack sudo[112713]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b/volume-748a356e-500d-4134-a83f-32e7d660cc87" returned: 0 in 0.646s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:14 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-quobyte-748a356e-500d-4134-a83f-32e7d660cc87" released by "delete_volume" :: held 1.433s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:14 devstack cinder-volume[93300]: DEBUG cinder.quota [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Created reservations ['778e509e-7f3f-42be-a7b9-d8c7f90161af', '7ea1ac5a-e5d0-42b4-b3cb-6ecb643fda11', 'becbdcb1-1227-4a59-89fc-519c7f9f6e53', 'f3991c1e-ec23-4580-affe-1a2592316211'] {{(pid=93300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:14 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:14 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:14 devstack sudo[112716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:35:14 devstack sudo[112716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:15 devstack sudo[112716]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:15 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.638s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:15 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:15 devstack cinder-volume[93300]: INFO cinder.volume.manager [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Deleted volume successfully. Jun 19 04:35:15 devstack cinder-volume[93300]: DEBUG cinder.coordination [None req-31517299-0b47-4442-85a3-6400847d6bef tempest-SnapshotDependencyTests-125100076 None] Lock "cinder-748a356e-500d-4134-a83f-32e7d660cc87-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=93300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:35:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b': None} {{(pid=93300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:19 devstack cinder-volume[93300]: DEBUG cinder.volume.drivers.quobyte [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6d630c6-4f66-467c-bab5-c0e18da1d36b'] {{(pid=93300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.lockutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:19 devstack sudo[112723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b Jun 19 04:35:19 devstack sudo[112723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:19 devstack sudo[112723]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:19 devstack cinder-volume[93300]: DEBUG oslo_concurrency.processutils [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1bf215c749152721c97438506144d2b" returned: 0 in 0.657s {{(pid=93300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:19 devstack cinder-volume[93300]: DEBUG cinder.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Notifying Schedulers of capabilities ... {{(pid=93300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:19 devstack cinder-volume[93300]: DEBUG oslo_service.periodic_task [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] Running periodic task VolumeManager._thread_info {{(pid=93300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:35:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread count: 29 {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:35:19 devstack cinder-volume[93300]: DEBUG cinder.volume.manager [None req-7ac623a1-7eeb-4362-a3d2-7753fbdd3777 None None] thread info: [<_MainThread(MainThread, started 134046770114688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:35:24 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=84,cinder:UPDATE=117,cinder:DELETE=8,cinder:INSERT=30 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:35:25 devstack cinder-volume[93300]: DEBUG dbcounter [-] [93300] Writing DB stats cinder:SELECT=79,cinder:DELETE=11,cinder:UPDATE=116,cinder:INSERT=28 {{(pid=93300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}